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(SI) Abstract 

A content-aware flow switch (110) intercepts a client content request in an IP netw rk (100), and transparently directs the content 
request to a best-fit server. The best-fit server is chosen based on the type of content requested, the quality f service requirements implied 
by the content request, die degree of lead on available servers (100a-c), network congestion inf rmati n, and t he pro ximity of the client to 
available servers. The flow switch (110) detects client-server flows based on the arrival of TCP SYNs and/or HTIP GETs from the client. 
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CONTENT -AWARE FLOW SWITCHING 

References to Related Applications 
This application claims priority from a 
provisional application Ser. No. 60/054,687, filed August 
5 1, 1997, which is hereby incorporated by reference. 

Background of the Invention 
The present invention relates to content-based 
flow switching in Internet Protocol (IP) networks. 

IP networks route packets based on network address 

10 information that is embedded in the headers of packets. 
In the most general sense, the architecture of a typical 
data switch consists of four primary components: (1) a 
number of physical network ports (both ingress ports and 
egress ports), (2) a data plane, (3) a control plane, and 

is (4) a management plane. The data plane, sometimes 

referred to as the "fastpath," is responsible for moving 
packets from ingress ports of the data switch to egress 
ports of the data switch based on addressing information 
contained in the packet headers and information from the 

20 data switch's forwarding table. The forwarding table 
contains a mapping between all the network addresses the 
data switch has previously seen and the physical port on 
which packets destined for that address should be sent. 
Packets that have not previously been mapped to a 

25 physical port are directed to the control plane. The 
control plane determines the physical port to which the 
packet should be forwarded. The control plane is also 
responsible for updating the forwarding table so that 
future packets to the same destination may be forwarded 

30 directly by the data plane. The data plane functionality 
is commonly performed in hardware. The management plane 
performs administrative functions such as providing a 
user interface (UI) and managing Simple Network 
Management Protocol (SNMP) engines. 
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Packets conforming to the TCP/IP Internet layering 
model have 5 layers of headers containing network address 
information, arranged in increasing order of abstraction. 
A data switch is categorized as a layer N switch if it 
5 makes switching decisions based on address information in 
the N th layer of a packet header. For example, both Local 
Area Network (LAN, layer 2) switching and IP (layer 3) 
switching switch packets based solely on address 
information contained in transmitted packet headers. In 
10 the case of LAN switching, the destination MAC address is 
used for switching, and in the case of IP switching, the 
destination IP address is used for switching. 

Applications that communicate over the Internet 
typically communicate with each other over a transport 
is layer (layer 4) Transmission Control Protocol (TCP) or 
User Datagram Protocol (UDP) connection. Such 
applications need not be aware of the switching that 
occurs at lower levels (levels 1-3) to support the layer 
4 connection. For example, an HyperText Transfer 
20 Protocol (HTTP) client (also known as a web browser) 
exchanges HTTP (layer 5) control messages and data 
(payload) with a target web server over a TCP (layer 4) 
connection. 

"Content" can be loosely defined as any 
25 information that a client application is interested in 
receiving. In an IP network, this information is 
typically delivered by an application- layer server 
application using TCP or UDP as its transport layer. The 
content itself may be, for example, a simple ASCII text 
30 file, a binary file, an HTML page, a Java applet, or 
real-time audio or video. 

A "flow" is a series of frames exchanged between 
two connection endpoints defined by a layer 3 network 
address and a layer 4 port number pair for each end of 
35 the connection. Typically, a flow is initiated by a 
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request at one of the two connection endpoints for 
content which is accessible through the other connection 
endpoint. The flow that is created in response to the 
request consists of (1) packets containing the requested 
5 content, and (2) control messages exchanged between the 
two endpoints. 

Flow classification techniques are used to 
associate priority codes with flows based on their 
Quality of Service (QoS) requirements. Such techniques 

10 prioritize network requests by treating flows with 

different QoS classes differently when the flows compete 
for limited network resources. Flows in the same QoS 
class are assigned the same priority code. A flow 
classification technique may, for example, classify flows 

15 based on IP addresses and other inner protocol header 
fields. For example, a QoS class with a particular 
priority may consist of all flows that are destined for 
destination IP address 142.192.7.7 and TCP port number 80 
and TOS of 1 (Type of Service field in the IP header) . 

20 This technique can be used to improve QoS by giving 
higher priority flows better treatment. 

Internet Service Providers (ISPs) and other 
Internet Content Providers commonly maintain web sites 
for their customers. This service is called web hosting. 

25 Each web site is associated with a web host. A web host 
may be a physical web server. A web host may also be a 
logical entity, referred to as a virtual web host (VWH) . 
A virtual web host associated with a large web site may 
span multiple physical web servers. Conversely, several 

30 virtual web hosts associated with small web sites may 

share a single physical web server. In either case, each 
virtual web host provides the functionality of a single 
physical web server in a way that is transparent to the 
client. The web sites hosted on a virtual web host share 

35 server resources, such as CPU cycles and memory, but are 
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provided with all of the services of a dedicated web 
server. A virtual web host has one or more public 
virtual IP address that clients use to access content on 
the virtual web host. A web host is uniquely identified 
5 by its public IP address. When a content request is made 
to the virtual web host's virtual IP address, the virtual 
IP address is mapped to a private IP address, which 
points either to a physical server or to a software 
application identified by both a private IP address and a 

10 layer 4 port number that is allocated to the application. 

Summary of the Invention 
In one aspect, the invention features content - 
aware flow switching in an IP network. Specifically, 
when a client in an IP network makes a content request, 

is the request is intercepted by a content -aware flow 

switch, which seamlessly forwards the content request to 
a server that is well -suited to serve the content 
request. The server is chosen by the flow switch based 
on the type of content requested, the QoS requirements 

20 implied by the content request, the degree of load on 
available servers, network congestion information, and 
the proximity of the client to available servers. The 
entire process of server selection is transparent to the 
client . 

25 In another aspect, the invention features implicit 

deduction of the QoS requirements of a flow based on the 
content of the flow request. After a flow is detected, a 
QoS category is associated with the flow, and buffer and 
bandwidth resources consistent with the QoS category of 

30 the flow are allocated. Implicit deduction of the QoS 
requirements of incoming flow requests allows network 
applications to significantly improve their Quality of 
Service (QoS) behavior by (1) preventing over-allocation 
of system resources, and (2) enforcing fair competition 

35 among flows for limited system resources based on their 
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QoS classes by using a strict priority and weighted fair 
queuing algorithm. 

In another aspect, the invention features flow 
pipes, which are logical pipes through which all flows 
5 between virtual web hosts and clients travel. A single 
content -aware flow switch can support multiple flow 
pipes. A configurable percentage of the bandwidth of a 
content-aware flow switch is reserved for each flow pipe. 

In another aspect, the invention features a method 

10 for selecting a best-fit server, from among a plurality 
of servers, to service a client request for content in an 
IP network. A location of the client is identified. A 
location of each of the plurality of servers is 
identified. Servers that are in the same location as the 

15 client are identified. A server from among the plurality 
of servers is selected as the best -fit server, using a 
method which assigns a proximity preference to the 
identified servers. The location of the client may be a 
continent in which the client resides. The location of 

20 each of the plurality of servers may be a continent in 
which the server resides. Servers that are in the same 
location as the client may be identified by identifying 
administrative authorities associated with the client 
based on its IP address, identifying, for each of the 

25 plurality of servers, administrative authorities 
associated with the server, and identifying servers 
associated with an administrative authority that is 
associated with the client. The administrative 
authorities may be Internet Service Providers. 

30 One advantage of the invention is that content - 

aware flow switches can be interconnected and overlaid on 
top of an IP network to provide content -aware flow 
switching regardless of the underlying technology used by 
the IP network. In this way, the invention provides 
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content -aware flow switching without requiring 
modifications to the core of existing IP networks. 

Another advantage of the invention is that by 
using content -aware flow switching, a server farm may 
5 gracefully absorb a content request spike beyond the 
capacity of the farm by directing content requests to 
other servers. This allows mirroring of critical content 
in distributed data centers, with overflow content 
delivery capacity and backup in the case of a partial 

10 communications failure. Content-aware flow switches also 
allow individual web servers to be transparently removed 
for service. 

Another advantage of the invention is that it 
performs admission control on a per flow basis, based on 

is the level of local network congestion, the system 

resources available on the content-aware flow switch, and 
the resources available on the web servers front -ended by 
the flow switch. This allows resources to be allocated 
in accordance with individual flow QoS requirements. 

20 One advantage of flow pipes is that the virtual 

web host associated with a flow pipe is guaranteed a 
certain percentage of the total bandwidth available to 
the flow switch, regardless of the other activity in the 
flow switch. Another advantage of flow pipes is that the 

25 quality of service provided to the flows in a flow pipe 
is tailored to the QoS requirements implied by the 
content of the individual flows. 

Another advantage of the invention is that, when 
performing server selection, a server in the same 

30 continent as the client is preferred over servers in 
another continent. Trans -continental network links 
introduce delay and are frequently congested. The server 
selection process tends to avoid such trans-continental 
links and the bottlenecks they introduce. 
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Another advantage of the invention is that, when 
performing server selection, a server that shares a 
"closest" backbone ISP with the client is preferred. 
Backbone ISPs connect with one another at Network Access 
5 Points (NAP) . NAPs frequently experience congestion. By 
selecting a path between a client and a server that does 
not include a NAP, bottlenecks are avoided. 

Other features and advantages of the invention 
will become apparent from the following description and 
10 from the claims. 

Brief Description of the Drawings 
FIG. la is a block diagram of an IP network. 
FIG. lb is a block diagram of a segment of a 
network employing a content-aware flow switch, 
is FIG. lc is a block diagram of traffic flow through 

a content -aware flow switch. 

FIG. 2 is a block diagram illustrating operations 
performed by and communications among components of a 
content-aware flow switch during flow setup. 
20 FIG. 3 is a flow chart of a method for servicing a 

content request using a content -aware flow switch. 

FIG. 4 is a flow chart of a method for parsing a 
flow setup request. 

FIGS. 5 and 6 are flow charts of methods for 
25 sorting a list of candidate servers. 

FIG. 7 is a flow chart of a method for evaluating 
requested content. 

FIG. 8 is a flow chart of a method for sorting a 
list of candidate servers. . 
30 FIG. 9 is a flow chart of a method for filting 

servers from a list of candidate servers. 

FIG. 10 is a flow chart of a method for evaluating 
a server in a list of candidate servers. 

FIG. 11 is a flow chart of a method for ordering a 
35 server in a list of candidate servers. 
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FIGS. 12-16 are flows charts of methods for 
assigning a status to a server for purposes of ordering 
the server in a list of candidate servers. 

FIG. 17 is a flow chart of a method for assigning 
5 a flow to a local server. 

FIG. 18 is a flow chart of a method for attempting 
to satisfy a request for a flow. 

FIG. 19 is a flow chart of a method for 
constructing a QoS tag. 
io FIG. 20 is a flow chart of a method for locating 

QoS tags which are similar to a given QoS tag. 

FIGS. 21a-b are block diagrams of flow pipe 
traffic through a content-aware flow switch. 

FIG. 22 is a flow chart of a method for ordering 
is servers in a list of candidate servers based on 
proximity. 

FIG. 23 is a block diagram of a computer and 
computer elements suitable for implementing elements of 
the invention. 

20 Detailed Description 

Referring to FIG. la, in a conventional IP network 
100, such as the Internet, servers are connected to 
routers at the edges of the network 100. Each router is 
connected to one or more other routers . Each stream of 

25 information transmitted from one end station to another 
is broken into packets containing, among other things, a 
destination address indicating the end station to which 
the packet should be delivered. A packet is transmitted 
from one end station to another via a sequence of 

30 routers. For example, a packet may originate at server 
SI, traverse routers Rl, R2, R3, and R4 ; and then be 
delivered to server S2 . 

In FIG. la, a network node is either a router or 
an end station. Each router has access to information 

35 about each of the nodes to which the router is connected. 



WO 99/06913 



PCT/US98/11912 



- 9 - 

When a router receives a packet, the router examines the 
packet's destination address, and forwards the packet to 
a node that the router calculates to be most likely to 
bring the packet closer to its destination address. The 
5 process of choosing an intermediary destination for a 
packet and forwarding the packet to the intermediary 
destination is called routing. 

For example, referring to FIG. la, server SI 
transmits a packet, whose destination address, is server 

10 S2, to router Rl . Router Rl is only connected to server 
SI and to router R2 . Router Rl therefore forwards the 
packet to router R2 . When the packet reaches router R2 , 
router R2 must choose to forward the packet to one of 
routers Rl, R5, R3 , and R6 based on the packet's 

is destination IP address. The packet is passed from router 
to router until it reaches its destination of server S2 . 

Referring to FIG. lb, web servers lOOa-c and 120a- 
b are connected to a content-aware flow switch 110. The 
web servers lOOa-c are connected to the flow switch 110 

20 over LAN links 105a-c. The web servers 120a-b .are 

connected to the flow switch 110 over WAN links 122a-b. 
The flow switch 110 may be configured and its health 
monitored using a network management station 125. The 
role of the management station 125 is to control and 

25 manage one or more communications devices from an 

external device such as a workstation running network 
management applications. The network management station 
125 communicates with network devices via a network 
management protocol such as the Simple Network Management 

30 Protocol (SNMP) . The flow switch 110 may connect to the 
network 100 (FIG. la) through a router 130. The flow 
switch 110 is connected to the router 13 0 by a LAN or WAN 
link 132. Alternatively, the flow switch 110 may connect 
to the network 100 directly via one or more WAN links 

35 (not shown) . The router 13 0 connects to an Internet 
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Service Provider (ISP) (not shown) by multiple WAN links 
135a-c. 

Referring to FIG. lc, a content -aware flow switch 
"front -ends 11 (i.e., intercepts all packets received from 
5 and transmitted by) a set of local web servers lOOa-c, 
constituting a web server farm 150. Although connections 
to the web servers lOOa-c are typically initiated by 
clients on the client side, most of the traffic between a 
client and the server farm 150 is from the servers lOOa-c 

10 to the client (the response traffic) . It is this 
response traffic that needs to be most carefully 
. controlled by the flow switch 110. 

The flow switch 110 has a number of physical 
ingress ports 170a-c and physical egress ports 165a-c. 

is Each of the physical ingress ports 170a-c may act as one 
or more logical ingress ports, and each of the physical 
egress ports 165a-c may act as one or more logical egress 
ports in the procedures described below. Each of the web 
servers lOOa-c is network accessible to the content-aware 

20 flow switch 110 via one or more of the physical egress 
ports 165a-c. Associated with each flow controlled by 
the flow switch 110 is a logical ingress port and a 
logical egress port. 

The flow switch 110 is connected to an internet 

25 through uplinks 155a-c. When a client content request is 
accepted by the flow switch 110, the flow switch 110 
establishes a full-duplex logical connection between the 
client and one of the web servers lOOa-c through the flow 
switch 110. Individual flows are aggregated into pipes, 

30 as described in more detail below. Request traffic flows 
from the client toward the server and response traffic 
flows from the server to the client. A component of the 
flow switch 110, referred to as the Flow Admission 
Control (FAC) , polices if and how flows are admitted to 

35 the flow switch 110, as described in more detail below. 
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The content -aware flow switch 110 differs from 
typical layer 2 and layer 3 switches in several respects. 
First, the data plane of layer 2 and layer 3 switches 
forwards packets based on the destination addresses in 
5 the packet headers (the MAC address and header 

information in the case of a layer 2 switch and the 
destination IP address in the case of a layer 3 switch) . 
The content-aware flow switch 110 switches packets based 
on a combination of source and destination IP addresses, 

10 transport layer protocol, and transport layer source and 
destination port numbers. Furthermore, the functions 
performed in the control plane of typical layer 2 and 
layer 3 switches are based on examination of the layer 2 
and layer 3 headers, respectively, and on well-known 

is bridging and routing protocols. The control plane of the 
content-aware flow switch 110 also performs these 
functions, but additionally derives the forwarding path 
from information contained in the packet headers up to 
and including layer 5. In addition, content -induced QoS 

20 and bandwidth requirements, server loading and network 
path optimization are also considered by the content- 
aware flow switch 110 when selecting the most optimal 
path for a packet, as described in more detail below. 

FIG. 2 is a block diagram illustrating, at a high 

25 level, operations performed by and communications among 
components of the content -aware flow switch 110 during 
flow setup. An arrow between two components in FIG. '2 
indicates that communication occurs in the direction of 
the arrow between the two components connected by the 

30 arrow. 

Referring to FIG. 2, the content -aware flow switch 
110 includes: a Web Flow Redirector (WFR) , an Intelligent 
Content Probe (ICP) , a Content Server Database (CSD) , a 
Client Capability Database (CCD) , a Flow Admission 
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Control (FAC) , an Internet Probe Protocol (IPP) , and an 
Internet Proximity Assist (IPA) . 

The CSD maintains several databases containing 
information about content flow characteristics, content 
5 locality, and the location of and the load on servers, 
such as servers lOOa-c and 120a-b. One database 
maintained by the CSD contains content rules, which are 
defined by the system administrator and which indicate 
how the flow switch 110 should handle requests for 

10 content. Another database maintained by the CSD contains 
content records which are derived from the content rules. 
Content records contain information related to particular 
content, such as its associated IP address, URL, 
protocol, layer 4 port number, QoS indicators, and the 

is load balance algorithm to use when accessing the content. 
A content record for particular content also points to 
server records identifying servers containing the 
particular content. Another database maintained by the 
CSD contains server records, each of which contains 

20 information about a particular server. The server record 
for a server contains, for example, the server's IP 
address, protocol, a port of the server through which the 
server can be accessed by the flow switch 110, an 
indication of whether the server is local or remote with 

25 respect to the flow switch 110, and load metrics 
indicating the load on the server. 

Information in the CSD is periodically updated 
from various sources, as described in more detail below. 
The WFR, CSD, and FAC are responsible for selecting a 

30 server to service a content request based on a variety of 
criteria. The FAC uses server-specific and content - 
specific information together with client information and 
QoS requirements to determine whether to admit a flow to 
the flow switch 110. The ICP is a lightweight HTTP 

35 client whose job is to populate the CSD with server and 
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content information by probing servers for specific 
content that is not found in the CSD during a flow setup. 
The ICP probes servers for several reasons, including: 
(1) to locate specific content that is not already stored 
5 in the CSD, (2) to determine the characteristics of known 
content such as its size, (3) to determine relationships 
between different pieces of content, and (4) to monitor 
the health of the servers. ICPs on various flow switches 
communicate with each other using the IPP, which 

10 periodically sends local server load and content 

information to neighboring content-aware flow switches. 
The CCD contains information related to the known 
capabilities of clients and is populated by sampling 
specific flows in progress. The IPA periodically updates 

is the CSD on the internet proximity of servers and clients. 

A flow setup request may take the form of a TCP 
SYN from a client being forwarded to the WFR (202) . The 
WFR passes the flow setup request to the CSD (204) . The 
CSD determines which servers, if any, are available to 

20 service the flow request and generates a list of such 
candidate servers (206) . This list of candidate servers 
is ordered based on configurable CSD preferences. The 
individual items within this list contain all the 
information the FAC will ultimately need to make flow 

25 admission decisions. 

If more than one server exists in the server farm 
150 and content is not fully replicated among the servers 
in the server farm, then it may not be possible for the 
CSD to identify any candidate servers based upon the 

30 receipt of the TCP SYN alone. In this case, the CSD 
returns a NULL candidate server list to the WFR with a 
status indicator requesting that the TCP connection is to 
be spoofed and that the subsequent HTTP GET is to be . 
forwarded to the CSD (212). 
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If the CSD contains no content records for servers 
that can satisfy the received TCP SYN or HTTP GET, a NULL 
list is returned to the WFR with a status indicator 
indicating that the flow request should be rejected 
5 (212) . If the CSD finds a content record that satisfies 
the HTTP GET but does not find a record for the specific 
piece of content requested, a new content record is 
created containing default values for the specific piece 
of content requested. The new record is then returned to 

10 the WFR (212). In either of these two cases (i.e., the 
CSD finds no matching records, or the CSD finds a 
matching record that does not exactly match the requested 
content) , the CSD asks the ICP to probe the local servers 
(using http "HEAD" operations) to determine where the 

is content is located and to deduce the content's QoS 
attributes (208) . 

The CSD then asks the CCD for information related 
to the client making the request (211) . The CCD returns 
any such information in the CCD to the CSD (210) . The 

20 CSD returns an ordered list of candidate servers and any 
client information obtained from the CCD to the WFR 
(212) . 

Depending on the response returned from the CSD, 
the WFR will either: (1) reject, TCP spoof, or redirect 

25 the flow as appropriate (214) , or (2) forward the flow 
request, the list of candidate servers, and any client 
information to the FAC for selection and local setup 
(216) . The FAC evaluates the list of servers contained 
in this content record, in the order specified by the CSD, 

30 and looks for a server that can accept the flow (218) . 
The FAC's primary consideration in selecting a server 
from the list of candidate servers is that sufficient 
port and switch resources be available on the content - 
aware flow switch to support the flow. An accepted flow 

35 is assigned either to a VC-pipe or to a flow pipe, as 
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appropriate. (VC-pipes and flow pipes are described in 
more detail below.) The FAC also adjusts flow weights as 
necessary to maintain flow pipe bandwidth. 

The FAC informs the WFR of which local server, if 
5 any, was chosen to accept the flow, and provides 

information to the WFR indicating to which specific VC- 
pipe or flow pipe the flow was assigned (220) . The WFR 
sets up the required network address translations for 
locally accepted flows so that future packets within the 

10 flow can be modified appropriately (222) . If the chosen 
server is "remote" (not in the local server farm) (220) , 
an HTTP redirect is generated (222) that causes the 
client to go to the chosen remote site for service. 
In addition to the steps described above, which 

is occur as part of the flow setup process, the components 
shown in FIG. 2 perform several other tasks, including 
the following. Periodically, the ICP probes the servers 
lOOa-c front-ended by the content-aware flow switch 110 
for information regarding server status and content. 

20 This activity may be undertaken proactively (such as 
polling for general server health) or at the request of 
the CSD. The ICP updates the CSD with the results of 
this search so that future requests for the same content 
will receive better service (224) . 

25 The IPP periodically sends local server load and 

content information to neighboring content-aware flow 
switches. Data arriving from these peers is evaluated 
and appropriate updates are sent to the CSD (226) . The 
IPA periodically updates the CSD with internet proximity 

30 information (228) . 

The operation of the components shown in FIG. 2 is 
now described in more detail. 

Referring to FIG. 3, the WFR services a client 
content request as follows. When a client sends a 

35 content request to a server in the form of a TCP SYN or 
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HTTP GET, the content request is intercepted by the 
content -aware flow switch 110, which interprets the 
request as a request to initiate a flow between the 
client and an appropriate server (step 4 02) . The CSD is 
5 queried for a list of available servers to serve the 
content request (step 404) . The CSD returns a list of 
candidate servers and the status indicator ACCEPT if the 
preferred server is known to be in the local server farm. 
If the CSD returns a status indicator ACCEPT (decision 

10 step 406) , then the content request may be served at one 
of the local servers lOOa-c front -ended by the flow 
switch 110. In this case, the FAC is asked to assign a 
flow for servicing the content request to a local server, 
chosen from among the list of candidate servers returned 

is by the CSD (step 408) . If the FAC successfully assigns 
the flow to a local server (decision step 412) , then an 
appropriate network address translation for the flow is 
set up (step 416) , a connection is set up with the 
appropriate server (using a pre-cached, persistent, or 

20 newly created connection) (step 426) , and the content 
request is passed to the server (step 428) . 

If the CSD is unable to identify any local servers 
to serve the content request (decision step 406) , or if 
the FAC is unable to assign a flow for the content 

25 request to a local server (decision step 412) , then if 
the status indicator (returned by either the CSD in step 
404 or the FAC in step 408) indicates that the flow 
should be redirected to a remote server (step 410) , then 
the flow is redirected to a remote server (step 414) . If 

30 the CSD indicated (in step 4 04) that the flow should be 
spoofed (decision step 418) , then the client TCP request 
is spoofed (step 420) . If the flow cannot be assigned to 
any server, then the flow is rejected with an appropriate 
error (step 422) . 
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Referring to FIG. 4, the CSD parses a flow setup 
request as follows. First, the CSD parses the URI 
representing the client content request in order to 
identify the nature of the requested content (step 429) . 
5 If the request is an HTTP request, for example, elements 
of the HTTP header, including the HTTP content -type, are 
extracted. In the case of a non-HTTP request, the 
combination of protocol number and source/destination 
port are used to identify the nature of the requested 

10 content. In the case of an HTTP request, the content - 
type or filename extension is used to deduce a QoS class, 
delay, minimum bandwidth, and frame loss ratio as shown 
in Table 1, below. The content-size is used to determine 
the size of the requested flow. Overall flow intensity 

is is monitored by the content -aware flow switch 110 by 
calculating the average throughput of all flows. The 
degree to which a particular piece of content served by a 
server is "hot content" is measured by monitoring the 
number of hits (requests) the content receives. The 

20 burstiness of a flow is determined by calculating the 
number of flows per content per time unit. 

Identifying the nature of the requested content also 
involves deducing, from the content request and 
information stored in the CSD, the QoS requirements of 

25 the requested content. These QoS requirements include: 

Bandwidth, defined by the number of bytes of content 
to be transferred over the average flow duration. 

Delay, defined as the maximum delay suitable for 
retrieving particular content. 

30 Frame Loss Ratio, defined as the maximum acceptable 

percentage of frame loss tolerated by the particular type 
of content . 

A QoS class is assigned to a flow based on the 
flow's calculated QoS requirements. Eight QoS classes 
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are supported by the flow switch 110. Table 1 indicates 
how these classes might be used. 



QoS 
Class 


Delay 

(End to End) 
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Ratio 
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Stock Ticker, 
News 
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N/A 


N/A 


IO' 8 


Service 
Distribution, 
Internet 
Printing 


7 


N/A/ 


N/A 


IO" 4 


Best effort 
traffic (email, 
Internet fax, 
database, etc.) 



Table 1 



After the nature of the requested content has been 
15 identified, the CSD queries its database for records of 
candidate servers containing the requested content (step 
430) . If the CSD cannot find any records in the database to 
satisfy a given content request (decision step 432), the 
ICP/IPP is asked to locate the requested content, in order 
20 to increase the probability that future requests for the 
requested content will be satisfied (step 446). .The CSD 
then returns a NULL list to the WFR with a status indicator 
indicating that the flow request should be rejected (steps 
434, 444) . 
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If one or more matching server records are found 
(decision step 432) and the client request is in the form 
of a HTTP GET (decision step 436) , then the CSD 
determines whether any of the existing content records 
5 exactly matches the requested content (decision step 
44 8) . For example, consider a content request for 
ht tp : / /www . company . com/document . html . The CSD wi 1 1 
consider a content record for http://www.company.com/* to 
be an exact match for the content request. The CSD will 

10 consider a record for http://www.company.com/ to be a 
match for the request, but not the most specific match. 
In the case of an exact match, the CSD sorts the list of 
candidate servers (identified in step 430) based on 
configurable preferences (step 442) . In the case of at 

is least one match but no exact matches, the CSD creates a 
new record containing default information extracted from 
the most specific matching record, as well as additional 
information gleaned from the content request itself (step 
450) . This additional information may include the QoS 

20 requirements of the flow, based on the port number of the 
content request, or the filename extension (e.g., " .mpg" 
might indicate a video clip) contained in the request . 
The CSD asks the ICP/IPP to probe, in the background, for 
more specific information to use for future requests 

25 (step 452) . 

If one or more server records are found (decision 
step 432) and the client content request is in the form 
of a TCP SYN (decision step 436) , the mere receipt by the 
flow switch of a TCP SYN may not provide the CSD with 

30 enough information about the nature of the requested flow 
for the CSD to make a determination of which available 
servers can service the requested flow. For example, the 
TCP SYN may indicate the server to which the content 
request is addressed, but not indicate which specific 

35 piece of content is being requested from the server. If 
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receipt of a HTTP GET from the client is required to 
identify a server to serve the content request (decision 
step 438), then the CSD returns a NULL server list to the 
WFR with a status indicator requesting that the TCP 
5 connection be spoofed and that the subsequent HTTP GET 
from the client be forwarded to the CSD (step 440) . 

If the TCP SYN is adequate to identify a server to 
service the content request (decision step 438) , then the 
CSD sorts the list of candidate servers (identified in 

10 step 430) based on configurable preferences (step 442) . 

If adequate information was available in the content 
request to generate a list of available servers (decision 
step 432) and the request may be serviced by one of the 
servers locally attached to the data switch (decision 

is step 451), then the Client Capability Database (CCD) is 
queried for any available information on the capabilities 
of the requesting client (step 453) . 

Referring to FIG. 5, given a content request and a 
list of candidate servers, the CSD sorts the list of 

20 candidate servers as follows. If the CSD content records 
indicate that the requested content is "sticky" (i.e., 
that a client who accesses such content must remain 
attached to a single server for the duration of the 
transaction between the client and the server, which 

25 could be comprised of multiple individual content 

requests) (decision step 454), then the CSD searches an 
internal database to determine to which server this 
client was previously "stuck" (step 456) . If the CSD 
finds no record for this client (decision step 458) , then 

30 the CSD indicates that the request should be rejected 
(step 464) . If the CSD finds a record of this client 
(decision step 458) , then the CSD creates and returns a 
list of candidate servers which includes only the 
"sticky" server to which the client was previously 

35 "stuck" (step 460) , and indicates that a local server to 
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serve the content request was found (step 462) . If the 
requested content is not "sticky" (decision step 454), 
then the list of candidate servers is ordered according 
to the method of FIG. 6 (step 456) . 
5 Referring to FIG. 6, the CSD orders the list of 

candidate servers as follows. The CSD evaluates the 
requested content according to several criteria (step 
468) . The CSD filters the candidate server list and 
orders (sorts) the candidate servers remaining in the 
10 candidate server list (step 470) . Servers in the 

candidate server list are assigned proximity preferences 
(step 472) . 

If the first server in the sorted list of candidate 
servers is a remote server (decision step 474) , then the 

is CSD assigns a value of REDIRECT to a status indicator 
(step 476) . If the first server in the sorted list of 
candidate servers is a local server (decision step 474) , 
then the CSD assigns a value of ACCEPT to the status 
indicator (step 478) . The CSD returns the status 

20 indicator and the ordered list of candidate servers (step 
480) . 

Referring to FIG. 7, a particular requested content 
is evaluated by the CSD as follows. A variable 
requestFlag is used to store several flags (values which 

25 can be either true or false) relating to the requested 
content. Flags stored in requestFlag include BURSTY 
(indicating whether the requested content is undergoing a 
burst of requests) , LONG (indicating that this the 
request is likely to result in a long-lived flow) , 

30 FREQUENT (indicating that the requested content is 

frequently requested), and HI_PRIORITY (indicating that 
the requested content is high priority content) . 

If the current time at which the requested content 
is being requested minus the previous time at which the 

35 requested content was requested is not greater than 
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avglnterval (the average period of time between flow 
requests for the requested content) (decision step 482) , 
then a variable burstLength is assigned a value of zero 
(step 484) and requestFlag is assigned a value of zero 
5 (step 486) . Otherwise (decision step 482) , the value of 
the variable burstLength is incremented (step 488) , and 
if the value of burstLength is greater than M I N_BUR S T_RUN 
(decision step 490) , then avglnterval is recalculated 
(step 492) , and the variable requestFlag is assigned a 
value of BURSTY (step 4 94) . MIN_BURST_RUN is a 
configurable value which indicates how many sub- 
avglnterval requests for a given piece of content 
constitute the beginning of a burst. 

A variable runTime is set equal to the current time 
(step 4 96) . A flag requestFlag is used to store several 
pieces of information describing the requested content. 
If the size of the requested content is greater than a 
predetermined constant SMALL_CONTENT (decision step 498) , 
then the LONG flag in requestFlag is set (step 502) . If 
the requested content is streamed (decision step 500) , 
then the LONG flag in requestFlag is set (step 502) . If 
the number of hits the requested content has received is 
greater than a predetermined constant HOTJ20NTENT 
(decision step 504), then the FREQUENT flag in 
5 requestFlag is set (step 506) . If the requested content 
has previously been flagged as HIGH_PRIORITY (decision 
step 508) , then the HI_PRIORITY flag in requestFlag is 
set (step 510) . 

Referring to FIG. 8, the CSD assigns status 
o indicators to the servers in the candidate server list as 
follows. The first server in the candidate server list 
is selected (step 514) . If the selected server should be 
filtered (decision step 516) , then the selected server is 
removed from the candidate server list (step 518) . 
5 Otherwise, the server is evaluated (step 520) , and 
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ordering rules are applied to the selected server to 
assign a status indicator to the selected server (step 
522) . If there are more servers in the candidate server 
list (decision step 524) , then the next server in the 
5 candidate server list is selected (step 526) , and steps 
516-524 are repeated. Otherwise, assignment of status 
indicators to the servers in the candidate server list is 
complete (step 528) . 

Referring to FIG. 9, servers are filtered from the 

10 candidate server list as follows. If a server has not 
responded to recent queries (decision step 530) , is no 
longer reachable due to a network topology change 
(decision step 532) , or no longer contains the requested 
content (indicated by an HTTP 4 04 error in response to a 

is request for the requested content) , then the server is 
flag for removal from the candidate server list (step 
536) . 

Referring to FIG. 10, a server in the candidate 
server list is evaluated as follows. A variable 

20 serverFlag is used to store several flags relating to the 
server. Flags stored in serverFlag include RECENT_THIS 
(indicating that a request was recently made to the 
server for the same content as is being requested by the 
current content request), RECENTJDTHER (indicating that a 

25 request was recently made to the server for content other 
than the content being requested by the current content 
request) , RECENT_MANY (indicating that many distinct 
requests for content have recently been made to the 
server) , LOW_BUFFERS (set to TRUE when one or more recent 

30 requests have been streamed), RECENT_LONG (indicating 
that one or more of the server's recent flows was long- 
lived), LOW_PORT_BW (indicating that the server's port 
bandwidth is low) , and LOW_CACHE (indicating that the 
server is low on cache resources) . 
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If the server was" not recently accessed (decision 
step 54 0) , then none of the flags in serverFlag are set, 
and evaluation of the server is complete (step 570) . 
Otherwise , if the server was recently accessed for the 
5 same content as is being requested by the current content 
request (decision step 542) , then serverFlag is assigned 
a value of RECENT_THIS (step 546) ; otherwise, serverFlag 
is assigned a value of RECENT_OTHER (step 548) . If there 
have been many recent distinct requests to the server 

10 (decision step 550), then the RECENTJ4ANY flag in 
serverFlag is set (step 552) . If any of the recent 
requests to the server. were streamed (decision step 554), 
then the LOW_BUFFERS flag of serverFlag is set (step 
556) . If any of the recent requests to the server were 

is long-lived (decision step 558) , then the RECENT_LONG flag 
of serverFlag is set (step 560) . If the port bandwidth 
of the server is low (decision step 562) , then the 
LOW_PORT_BW flag of serverFlag is set (step 564) . If the 
RECENT_OTHER flag of serverFlag is set (decision step 

20 566) , then the LOW_CACHE flag of serverFlag is set (step 
568) . 

Referring to FIG. 11, a server in the candidate 
server list is ordered within the candidate server list 
as follows. A variable Status is used to indicate 

25 whether the server should be placed at the bottom of the 
candidate server list. Specifically, if the HI_PRIORITY 
flag of requestFlag is set (decision step 572) , then 
Status is assigned a value according to FIG. 12 (step 
574) . If the BURSTY flag of requestFlag is set (decision 

30 step 576) , then Status is assigned a value according to 
FIG. 13 (step 578) . If the FREQUENT flag of requestFlag 
is set (decision step 580) , then Status is assigned a 
value according to FIG. 14 (step 582) . If the LONG flag 
of requestFlag is set (decision step 584), then Status 

35 assigned a value according to FIG. 15 (step 586) ; 
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otherwise, Status is assigned a value according to FIG. 
16 (step 588) . If the value of Status is not OKAY 
(decision step 590), then the server is considered not 
optimal and is placed at the bottom of the candidate 
5 server list (step 584) . Otherwise, the server is 

considered adequate and is not moved within the candidate 
server list (step 592) . 

Referring to FIG* 12, in the case of a request for a 
flow for which the HI_PRIORITY flag of requestFlag is 

10 set, if the LOW_CACHE flag of serverFlag is set (decision 
step 596) , the RECENT_OTHER flag of serverFlag is set 
(decision step 598) , the LOW_PORT_BW flag of serverFlag 
is set (decision step 600) , or the RECENT_LONG flag of 
serverFlag is set (decision step 602), then Status is 

is assigned a value of NOTJDPTIMAL (step 608) . Otherwise, 
Status is assigned a value of OKAY (step 604) . 

Referring to FIG. 13, in the case of a request for a 
flow for which the BURSTY requestFlag is set and the 
RECENT_THIS serverFlag is not set (decision step 608) , 

20 and if either the LOW_CACHE or RECENT_MANY serverFlag is 
set (decision steps 610 and 612) , then Status is assigned 
a value of NOT_OPTIMAL (step 616) . Otherwise, Status is 
assigned a value of OKAY (step 614) . 

Referring to FIG. 14, a value is assigned to Status 

25 in the case of a request for a flow which is not bursty 
and not frequently requested as follows. Status is 
assigned a value of NOT_OPTIMAL (step 64 4) if any of the 
following conditions obtain: (1) the LONG flag of 
requestFlag is set and the LOW_BUFFERS and LOW_CACHE 

30 flags of serverFlag are set (decision steps 62 0, 622, and 
624); (2) the RECENT JYIANY, RECENT_THIS , and LOW_CACHE 
flags of serverFlag are set (decision steps 626, 628, and 
630); ( 3 ) the RECENT_LONG , RECENT_THI S , and LOW_CACHE 
flags of serverFlag are set (decision steps 632, 634, and 

35 636) ; or (4) the LONG flag of requestFlag is set and the 
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LOW_PORT_BW flag of serverFlag is set (decision steps 638 
and 640) - Otherwise, Status is assigned a value of OKAY 
(step 642) . 

Referring to FIG. 15, a value is assigned to Status 
5 in the case of a request for a flow which is non-bursty, 
frequently requested, and short-lived as follows. Status 
is assigned a value of NOT_OPTIMAL (step 664) if any of 
the following conditions obtain: (1) the LOW_BUFFERS and 
LOW_CACHE flags of serverFlag are set (decision steps 

10 646, 648); (2) the RECENT_LONG, RECENT_OTHER , and 

LOW_CACHE flags of serverFlag are set (decision steps 
650, 652, and 654); or (3) the RECENT_MANY, RECENT_OTHER, 
and LOW_CACHE flags of serverFlag are set (decision steps 
656, 658, and 660) . Otherwise, Status is assigned a 

15 value of OKAY (step 662). 

Referring to FIG. 16, a value is assigned to Status 
in the case of request for flows which are not handled by 
any of FIGS. 12-15 as follows. Status is assigned a 
value of NOTJDPTIMAL (step 680) if any of the following 

20 conditions obtain: (1) the LOW_BUFFERS and LOW_CACHE 
flags of serverFlag are set (decision steps 666, 668); 
(2) the RECENTJVIANY and L0W_CACHE flags of serverFlag are 
set (decision steps 67 and 672); or (3) the RE CENT_L0NG 
and LOW_PORT_BW flags of serverFlag are set (decision 

25 steps 674 and 676) . Otherwise, Status is assigned a 
value of OKAY (step 678) . 

Referring again to FIG. 6, the servers remaining in 
the candidate server list are sorted again, this time by 
proximity to the client making the content request (step 

30 472) . The details of sorting by proximity are discussed 
in more detail below with respect to the Internet 
Proximity Assist (IPA) and with respect to FIG. 22. 

The first server in the candidate server list is 
examined, and if it is local to the content-aware flow 

35 switch 110 (decision step 474) , then a variable Status is 
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assigned a value of ACCEPT (step 478) , indicating that 
the content-aware flow switch 110 can service the 
requested flow using a local server. Otherwise, Status 
is assigned a value of REDIRECT (step 476) , indicating 
5 that the flow request should be redirected to a remote 
server. 

The process of deciding whether to create a flow in 
response to a client content request is referred to as 
Flow Admission Control (FAC). Referring again to FIG. 3, 

10 if the value of Status is ACCEPT (decision step 406) , 
then the FAC is asked to assign the requested flow to a 
local server (step 408) . The FAC admits flows into the 
flow switch 110 based on flow QoS requirements and the 
amount of link bandwidth, flow switch bandwidth, and flow 

15 switch buffers. Flow admission control is performed for 
each content request in order to verify that adequate 
resources exist to service the content request, and to 
offer the content request the level of service indicated 
by its QoS requirements. If sufficient resources are not 

20 available, the content request may be redirected to 

another site capable of servicing the request or simply 
be rejected. 

More specifically, referring to FIG. 17, the FAC 
assigns a flow to a local server from among an ordered 

25 list of candidate servers, in response to a content 
request, as follows. First, the FAC fetches the first 
server record from the list of candidate servers (step 
684) . If the server record is for a local server 
(decision step 686), and the local server can satisfy the 

30 content request (decision step 690) , then the FAC 

indicates that the content request has been successfully 
assigned to a local server (step 694) . If the server 
record is not for a local server (decision step 686) , 
then the FAC indicates that the content request should be ■ 

35 redirected (step 688) . 
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If the server record is for a local server (decision 
step 686) that cannot satisfy the content request 
(decision step 690) , and there are more records in the 
list of candidate servers to evaluate (decision step 
5 696) , then the FAC evaluates the next record in the list 
of candidate servers (step 698) as described above. If 
all of the records have been evaluated without 
redirecting the request or assigning the request to a 
local server, then the content request is rejected, and 

10 no flow is set up for the content request (step 700) . 

Referring to FIG. 18, the FAC attempts to establish 
a flow between a client and a candidate server, in 
response to a client content request, as follows. The 
FAC extracts, from the CSD server record for the 

is candidate server, the egress port of the flow switch to 
which the candidate server is connected. The FAC also 
extracts, from the content request, the ingress port of 
the flow switch at which the content request arrived 
(step 726) . Using the information obtained in step 726 

20 and other information from the candidate server record, 
the FAC constructs one or more QoS tags (step 728) . A 
QoS tag encapsulates information about the deduced QoS 
requirements of an existing or requested flow. 

If the requested content is not served by a 

25 (physical or virtual) web host associated with a flow 
pipe (decision step 730) , then the FAC attempts to add 
the requested flow to an existing VC pipe (step 732) . A 
VC pipe is a logical aggregation of flows sharing similar 
characteristics; more specifically, all of the flows 

30 aggregated within a single VC pipe share the same ingress 
port, egress port, and QoS requirements. Otherwise, the 
FAC attempts to add the requested flow to the flow pipe 
associated with the server identified by the candidate 
server record (step 734) . Once the QoS requirements of a 

35 flow have been calculated, they are stored in a QoS tag, 
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so that they may be subsequently accessed without needing 
to be recalculated. 

Referring to FIG. 19, the FAC constructs a QoS tag 
from a candidate server record, ingress and egress port 
5 information, and any available client information, as 
follows. If the requested content is not to be delivered 
using TCP (decision step 738) , then the FAC calculates 
the minimum bandwidth requirement MinBW of the requested 
content based on the total bandwidth PortBW available to 
10 he logical egress port of the flow and the hop latency 
hopLatency (a static value contained in the candidate 
server record) of the flow, using the formula: 

MinBW = frameSize / hopLatency) 
Formula 1 

15 (step 756) . If the requested content is to be delivered 
using TCP (decision step 738) , then the FAC calculates 
the average bandwidth requirement AvgBW of the requested 
flow based on the size of the candidate server's cache 
CacheSize (contained in the candidate server record) , the 

20 TCP window size TcpW (contained in the content request) , 
and the round trip time RTT (determined during the 
initial flow handshake), using the. formula : 

AvgBW = min (CacheSize, TcpW) / RTT 
Formula 2 

25 (step 740) . The FAC uses the average bandwidth AvgBW and 
the flow switch latency (a constant) to determine the 
minimum bandwidth requirement MinBW of the requested 
content* using the formula: 



30 



MinBW = min (AvgBW * MinToAvg, clientBW) 

Formula 3 
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In Formula 3, MinToAvg is the flow switch latency and 
clientBW is derived from the maximum segment size (MSS) 
option of the flow request (step 742) . 

The content -aware flow switch 110 reserves a fixed 
s amount of buffer space for flows. The FAC is responsible 
for calculating the buffer requirements (stored in the 
variable Buffers) of both TCP and non-TCP flows, as 
follows. If the requested flow is not to be streamed 
(decision step 744) , then the flow is provided with a 

10 best-effort level of buffers (step 758) . Streaming is 
typically used to deliver real-time audio or video, where 
a minimum amount of information must be delivered per 
unit of time. If the content is to be streamed (decision 
step 744) , then the burst tolerance btol of the flow is 

15 calculated (step 746) , the peak bandwidth of the flow is 
calculated (step 748) , and the buffer requirements of the 
flow are calculated (step 750) . A QoS tag is constructed 
containing information derived from the calculated 
minimum bandwidth requirement and buffer requirements 

20 (step 752) . The FAC searches for any other similar 
existing QoS tags that sufficiently describe the QoS 
requirements of the requested content (step 754) . 

Referring to FIG. 20, the FAC locates any existing 
QoS tags which are similar enough (in MinBW and Buffers) 

25 to the QoS tag constructed in FIG. 19 to be acceptable 
for this content request, as follows. If the requested 
content is not to be delivered via TCP (decision step 
764) , then the FAC finds all QoS tags with a higher 
minimum bandwidth requirement but with lower buffer 

30 requirements than the given QoS tag (step 766) . If the 
content is to be delivered via TCP (decision step 764) , 
then the FAC finds all QoS tags with a lower minimum 
bandwidth requirement and higher buffer requirements than 
the given QoS tag (step 768) . If the requested content 

35 is not to be streamed (decision step 770) , then for each 
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existing QoS tag, the FAC calculates the average 
bandwidth, calculates the TCP window size as 
TcpW = AvgBW * RTT, and verifies that the TCP window size 
is at least 4K (the minimum requirement for HTTP 
5 transfers) (step 774) . If the requested content is to be 
streamed (decision step 770) , then the FAC examines each 
existing QoS tag and excludes those that are not capable 
of delivering the required peak bandwidth PeakBW or burst 
tolerance btol, as calculated in FIG. 19, steps 746 and 
10 748 (step 772) . The resulting list of QoS tags is then 
used when aggregating the flow into a VC-pipe or flow 
pipe. 

One of the effects of the procedures shown in FIGS, 
3-20 is that the flow switch 110 functions as a network 

is address translation device. In this role, it receives 
TCP session setup requests from clients, terminates those 
requests on behalf of the servers, and initiates (or 
reuses) TCP connections to the best-fit target server on 
the client's behalf. For that reason, two separate TCP 

20 sessions exist, one between the client and the flow 

switch, the other between the flow switch and the best- 
fit server. As such, the IP, TCP, and possible content 
headers on packets moving bidirectional ly between the 
client and server are modified as necessary as they 

25 traverse the content-aware flow switch 110. 

Flow Pipes 

A content-aware flow switch can be used to front -end 
many web servers. For example, referring to FIG. lc, the 
flow switch 110 front-ends web servers lOOa-c. Each of 
30 the physical web servers lOOa-c may embody one or more 
virtual web hosts (VWH's) . Associated with each of the 
VWH's front -ended by the flow switch 110 may be a "flow 
pipe," which is a logical aggregation of the VWH's flows. 
Flow pipes guarantee an individual VWH a configurable 



WO 99/06913 



PCT/US98/11912 



- 32 - 

amount of bandwidth through the content -aware flow switch 
110. 

Referring to FIG. 21a, web servers lOOa-c provide 
service to VWHs lOOd-f as follows. Web server 100a 
5 provides all services to VWH lOOd. Web server 100b 
provides service to VWH lOOe and a portion of the 
services to VWH lOOf . Web server 100c provides service 
to the remainder of VWH lOOf . Associated with VWHs lOOd- 
f are flow pipes 784a, 784b, and 784c, respectively. 

10 Note that flow pipes 784a-c are logical entities and are 
therefore not shown in FIG. 21a as connecting to VWH's .. 
lOOd-f or~the flow switch 110 at physical ports. 

The properties of each of the VWH's lOOd-f is 
configured by the system administrator. For example, 

15 each of the VWH's lOOd-f has a bandwidth reservation. 
The flow switch 110 uses the bandwidth reservation of a 
VWH to determine the bandwidth to be reserved for the 
flow pipe associated with the VWH. The total bandwidth 
reserved by the flow switch 110 for use by flow pipes, 

20 referred to as the flow pipe bandwidth, is the sum of all 
the individual flow pipe reservations. The flow switch 
110 allocates the flow pipe bandwidth and shares it among 
the individual flow pipes 784a-c using a weighted round 
robin scheduling algorithm in which the weight assigned 

25 to an individual flow pipe is a percentage of the overall 
bandwidth available to clients. The flow switch 110 
guarantees that the average total bandwidth actually 
available to the flow pipe at any given time is not less 
than the bandwidth configured for the flow pipe 

30 regardless of the other activity in the flow switch 110 
at the time. Individual flows within a flow pipe are 
separately weighted based on their QoS requirements. The 
flow switch 110 maintains this bandwidth guarantee by 
proportionally adjusting the weights of the individual 

35 flows in the flow pipe so that the sum of the weights 
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remains constant. By policing against over-allocation of 
bandwidth to a particular VWH, fairness can be achieved 
among the VWH's competing for outbound bandwidth through 
the flow switch 110. 
5 Again referring to FIG. 21a, consider the case in 

which the flow switch 110 is configured to provide 
service to three VWH's lOOd-f. Suppose that the 
bandwidth requirements of VWHIOOd-f are 64Kbps, 256Kbps, 
and 1.5Mbps, respectively. The total flow pipe bandwidth 

10 reserved by the flow switch 110 is therefore 1.82Mbps. 
Assume for purposes of this example that the flow switch 
110 is connected to the Internet by uplinks 115a-c with 
bandwidths of 45Mbps, 1.5Mbps, and 1.5Mbps, respectively, 
providing a total of 48Mbps of bandwidth to clients. In 

15 this example, flow pipe 784a is assigned a weight of 
.0013 ( 64Kbps/4 8Mbps) , flow pipe 784b is assigned a 
weight of .0053 (256Kbps/48Mbps) , and flow pipe 784c is 
assigned a weight of .0312 (1 . 5Mbps /48Mbps) . As 
individual flows within flow pipes 784a-c are created and 

20 destroyed, the weights of the individual flows are 

adjusted such that the total weight of the flow pipe is 
held constant. 

The relationship between flows, flow pipes, -and the 
physical ingress ports 170a-c and physical egress ports 

25 165a-c of the content-aware flow switch 110 is discussed 
below in connection with FIG. 21b. Flows 782a-c from VWH 
lOOd enter the flow switch at egress port 165a. Flows 
786a-b from VWH 100c enter the flow switch at egress port 
165b. Flow 786c from VWH lOOf enters the flow switch at 

30 egress port 165b. Flows 788a-c from VWH lOOf enters the 
flow switch from egress port 165c. After entering the 
flow switch 110, the flows 782a-c, 786a-c, and 788a-c are 
managed within their respective flow pipes 784a-c as they 
pass through the switching matrix 790. The switching 

35 matrix is a logical entity that associates a logical 
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ingress port and a logical egress port with each of the 
flows 782a-c, 786a-c, and 788a-c, As previously 
mentioned, each of the physical ingress ports 170a-c may 
act as one or more logical ingress ports, and each of the 
5 physical egress ports 165a-c may act as one or more 
logical egress ports. FIG. 21b shows a possible set of 
associations of physical ingress ports with flow pipes 
and physical egress ports for the flows 782a-c, 786a-c, 
and 788a-c. 

10 Internet Proximity Assist 

A client may request content that is available from 
several candidate servers. In such a case, the Internet 
Proximity Assist (IPA) module of the content -aware flow 
switch 110 assigns a preference to servers which are 

is determined to be "closest" to the client, as follows. 

The Internet is composed of a number of independent 
Autonomous Systems (AS's). An Autonomous System is a 
collection of networks under a single administrative 
authority, typically an Internet Service Provider (ISP) . 

20 The ISPs are organized into a loose hierarchy. A small 
number of "backbone" ISPs exist at the top of the 
hierarchy. Multiple AS's may be assigned to each 
backbone service provider. Backbone service providers 
exchange network traffic at Network Access Points (NAPs) . 

25 Therefore, network congestion is more likely to occur 
when a data stream must pass through one or more NAPs 
from the client to the server. The IPA module of the 
content -aware flow switch 110 attempts to decrease the 
number of NAPs between a client and a server by making an 

30 appropriate choice of server. 

The IPA uses a continental proximity lookup table 
which associates IP addresses with continents as follows. 
Most IP address ranges are allocated to continental 
registries. The registries, in turn, allocate each of 

35 the address ranges to entities within a particular 
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continent. . The continental proximity lookup table may* be 
implemented using a Patricia tree which is built based on 
the IP address ranges that have been allocated to various 
continental registries. The tree can then be searched 
5 using the well-known Patricia search algorithm. An IP 
address is used as a search key. The search results in a 
continent code, which is an integer value that represents 
the continent to which the address is registered. Given 
the current allocations of IP addresses, the possible 
10 return values are shown in Table 2 . 



ID 


Continent 


0 


Unknown 


1 


Europe 


2 


North America 


3 


Central and South America 


4 


Pacific Rim 



Table 2 



Additional return values can be added as IP 
addresses are allocated to new continental registries. 
20 Given the current allocation of addresses, the 

continental proximity table used by the IPA is shown in 
Table 3. 
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IP ADDRESS RANGE 


CONTINENT IDENTIFIER 


0.0.0,0 through 
192.255.255.255 


0 (Unknown) 


193.0.0.0 through 
195.255.255.255 


1 (Europe) 


196.0.0.0 through 
197.255.255.255 


0 (Unknown) 


198.0.0.0 through 
199.255.255.255 


2 (North America) 


200.0.0.0 through 
201.255.255.255 


3 (Central and South America) 


2 02.0.0.0 through 
203.255.255.255 


4 (Pacific Rim) 


204.0.0.0 through 
209.255.255.255 


2 (North America) 


210.0.0.0 through 
211.255.255.255 


4 (Pacific Rim) 


212.0.0.0 through 
223 .255.255.255 


0 (Unknown) 



20 Table 3 



Referring to FIG. 22, the IPA assigns proximity 
preferences to zero or more servers, from a list of 
candidate servers and a client content request, as 
follows. The IPA identifies the continental location of 

25 the client (step 800) . If the client continent is not 
known (decision step 801) , then control passes to step 
812, described below. Otherwise, the IPA identifies the 
continental location of each of the candidate servers 
(step 802) using the continental proximity lookup table, 

30 described above. If all of the server continents are 
unknown (decision step 803), control passes to step 807, 
described below. Otherwise, if none of the candidate 
servers are in the same continent as the client (decision 
step 804) , then the IPA does not assign a proximity 

35 preference to any of the candidate servers (step 806) . 

At step 807, the IPA prunes the list of candidate 
servers to those which are either unknown or in the same 
continent as the client. If there is exactly one server 
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in the same continent as the client (decision step 808) , 
then the server in the same continent as the client is 
assigned a proximity preference (decision step 810) . For 
purposes of decision steps 804 and 808, a client and a 
5 server are considered to reside in the same continent if 
their lookup results match and the matching value is not 
0 (unknown) . 

If there is more than one server in the same 
continent as the client (decision step 808) , then the IPA 

10 assigns a proximity preference to one or more servers, if 
any, which share a "closest" backbone ISP with the 
client, where "closest" means that the backbone ISP can 
reach the client without going through another backbone 
ISP. A closest -backbone lookup table, which may be 

is implemented using a Patricia tree, stores information 

about which backbone AS's are closest to each range of IP 
addresses. An IP address is used as the key for a search 
in the closest-backbone lookup table. The result of a 
search is a possibly empty list of AS's which are closest 

20 to the IP address used as a search key. 

The IPA performs a query on the closest -backbone 
lookup table using the client's IP address to obtain a 
possibly empty list of the AS's that are closest to the 
client (step 812) . The IPA queries the closest -backbone 

25 lookup table to obtain the AS's which are closest to each 
of the candidate servers previously identified as being 
in the same continent as the client (step 814) . The IPA 
then identifies all candidate servers whose query results 
contain an AS that belongs to the same ISP as any AS 

30 resulting from the client query performed in step 812 
(step 816) . Each of the servers identified in step 816 
is then assigned a proximity preference (step 818) . 

After any proximity preferences have been assigned 
in either step 810 or 818, the existence of a network 

35 path between the client and each of the preferred servers 
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is verified (step 820) . To verify the existence of a 
network path between the client and a server, the 
content -aware flow switch 110 queries the content -aware 
flow switch that front-ends the server. The remote 
5 content -aware flow switch either does a Border Gateway 
Protocol (BGP) route table lookup or performs a 
connectivity test, such as by sending a PING packet to 
the client, to determine whether a network path exists 
between the client and the server. The remote content - 

10 aware flow switch then sends a message to the content - 
aware flow switch 110 indicating whether such a path 
exists. Any server for which the existence of a network 
path cannot be verified is not assigned a proximity ■ 
preference. Servers to which a proximity preference has 

is been assigned are moved to the top of the candidate 
server list (step 822) . 

Because multiple AS's may be assigned to a single 
ISP, an ISP-AS lookup table is used to perform step 816. 
The ISP-AS lookup table is an array in which each element 

20 associates an AS with an ISP. An AS is used as a key to 
query the table, and the result of a query is the ISP to 
which the key AS is assigned. 

Referring to FIG. 23, the invention may be 
implemented in digital electronic circuitry or in 

25 computer hardware, firmware, software, or in combinations 
of them. Apparatus of the invention may be implemented , 
in a computer program product tangibly embodied in a 
machine -readable storage device for execution by a 
computer processor 1080; and method steps of the 

30 invention may be performed by a computer processor 108 0 
executing a program to perform functions of the invention 
by operating on input data and generating output. The 
processor 1080 receives instructions and data from a 
read-only memory (ROM) 1120 and/or a random access memory 

35 (RAM) 1110 through a CPU bus 1100. The processor 1080 
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can also receive programs and data from a storage medium 
such as an internal disk 1030 operating through a mass 
storage interface 1040 or a removable disk 1010 operating 
through an I/O interface 1020. The flow of data over an 
I/O bus 1050 to and from I/O devices and the processor 
1080 and memory 1110, 1120 is controlled by an I/O 
controller 1090. 

The present invention has been described in terms of 
an embodiment. The invention, however, is not limited to 
the embodiment depicted and described. Rather, the scope 
of the invention is defined by the claims. 
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What is claimed is: 

1. .In an Internet Protocol network, a method for 
directing a flow between a client and a best -fit server, 
the' method comprising: 

5 receiving a client request for content via the 

Internet Protocol network; 

deriving, from the client request, content type 
information descriptive of the type of content requested 
by the content request; 
io deriving, from the client request, quality of 

service information descriptive of quality of service 
requirements of the content requested by the client 
request ; 

selecting as the best -fit server a server from among 
is a set of candidate servers serving the content requested 
by the client request, based on the content type 
information, the quality of service information, and a 
combination of server metrics descriptive of expected 
qualities of service provided by the candidate servers 
20 when serving the requested content; 

subsequently forwarding to the best-fit server 
transmissions originating from the client which are 
associated with the client request for content; and 

subsequently forwarding to the client transmissions 
25 originating from the best-fit server which are associated 
with the client request for content. 

2. The method of claim 1, wherein the combination of 
server metrics includes: 

one or more metrics selected from the following 
30 group: server load metrics descriptive of the current 
load and recent activity on the candidate servers, 
network congestion metrics descriptive of network 
congestion between the client and the candidate servers, 
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and client-server proximity information descriptive of 
distances between the client and candidate servers. 

3. The method of claim 1, wherein the combination of 
server metrics includes : 

5 two or more metrics selected from the following 

group: server load metrics descriptive of the current 
load and recent activity on the candidate servers, 
network congestion metrics descriptive of network 
congestion between the client and the candidate servers, 
10 and client-server proximity information descriptive of 
distances between the client and candidate servers. 

4. The method of claim 1, wherein the combination of 
server metrics includes: 

server load metrics descriptive of the current load 
is and recent activity on the candidate servers, network 
congestion metrics descriptive of network congestion 
between the client and the candidate servers, and client - 
server proximity information descriptive of distances 
between the client and candidate servers. 
20 5. The method of claim 1, wherein the step of deriving 
quality of service information includes deriving quality 
of service information from the content type information. 

6. The method of claim 1, wherein the step of deriving 
quality of service information includes deriving quality 

25 of service information from a size of the content 
requested by the client request. 

7. The method of claim 1, wherein the client request is 
an HTTP request . 

8. The method of claim 7, wherein deriving content type 
30 information comprises: 

extracting content type information from an HTTP 
header of the client request. 

9. The method of claim 1, wherein the client request is 
a TCP request. 

35 10. The method of claim 1, further comprising: 
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obtaining additional information from the client 
about the content requested by the client request; and 

wherein the selecting step further comprises 
selecting the best -fit server based on the additional 
5 information. 

11. The method of claim 10, wherein the additional 
information comprises information derived from an HTTP 
GET. 

12. The method of claim 10, wherein the obtaining step 
10 comprises obtaining a protocol number and a source port 

of the client request. 

13. The method of claim 10, wherein the obtaining step 
comprises obtaining a protocol number and a destination 
port of the client request. 

is 14. The method of claim 10, wherein the obtaining step 
comprises obtaining a filename associated with the 
content request . 

15. The method of claim 10, wherein the obtaining step 
comprises obtaining a filename extension associated with 

20 the content request. 

16. The method of claim 1, wherein the server metrics 
are obtained by querying a content server database. 

17. The method of claim 1, wherein the server metrics 
are obtained by periodically querying servers in the 

25 Internet Protocol network. 

18. The method of claim 1, further comprising: 
obtaining client capability information about the 

client; and 

wherein the selecting step further comprises 
30 selecting the best-fit server based on the additional 
information. 

19. The method of claim 1, wherein quality of service 
requirements comprise a bandwidth. 

20. The method of claim 1, wherein quality of service 
35 requirements comprise a delay. 
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21. The method of claim 1, wherein quality of service 
requirements comprise a frame loss ratio. 

22. The method of claim 1, wherein deriving quality of 
service information comprises deriving quality of service 

5 information from the MIME content type of the client 
request . 

23. The method of claim 1, wherein the expected quality 
of service provided by a candidate server is descriptive 
of whether the candidate server is receiving a burst of 

10 requests for the content requested by the client request. 

24. The method of claim 1, wherein the expected quality 
of service provided by a candidate server is descriptive 
of whether satisfying the client request will result in a 
short-term flow. 

is 25. The method of claim 1, wherein the expected quality 
of service provided by a candidate server is descriptive 
of whether the content requested by the client request 
has been frequently requested in the past. 

26. The method of claim 1, wherein the expected quality 
20 of service provided by a candidate server is descriptive 

of whether the content requested by the client request 
has a high priority. 

27. The method of claim 1, wherein the expected quality 
of service provided by a candidate server is descriptive 

25 of a probability that the content requested by the client 
request is cached by the server. 
. 28. The method of claim 1, wherein the expected quality 
of service provided by a candidate server is descriptive 
of whether the candidate server has responded to recent 

30 queries. 

29. The method of claim 1, wherein the expected quality 
of service provided by a candidate server is descriptive 
of whether the candidate server recently responded to a 
request for the content requested by the client request 
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with an indication that the content is not served by the 
candidate server. 

30. The method of claim 1, wherein the expected quality 
of service provided by a candidate server is descriptive 

5 of whether the candidate server is reachable. 

31. The .method of claim 1, wherein the expected quality 
of service provided by a candidate server is descriptive 
of whether the candidate server's cache resources are 
below a threshold level. 

10 32. The method of claim 1, wherein the expected quality 
of service provided by a candidate server is descriptive 
of whether the candidate server's TCP buffer resources 
are below a threshold level. 

33. The method of claim 1, wherein the expected quality 
15 of service provided by a candidate server is descriptive 

of whether the candidate server's port bandwidth is below 

a threshold level. 
• 34. The method of claim 2, wherein client -server 

proximity information comprises information descriptive 
20 of a continent in which the client resides and a 

continent in which the. server resides. 

35. The method of claim 34, wherein client-server 
proximity information further comprises information 
descriptive of an administrative authority associated 

25 with the client and an administrative authority 
associated with the server. 

36. The method of claim 35, wherein the administrative 
authorities are Internet Service Providers. 

37. The method of claim 1, wherein selecting as the 
30 best-fit server comprises: 

determining whether the client request requires 
persistent connectivity with a particular candidate 
server; 

if the client request requires persistent 
35 connectivity with a. particular server, identifying a 
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candidate server with which the client is persistently 
connected for service of the client request; 

selecting the identified candidate server as the 
best -fit server. 
5 38. A method for allocating bandwidth of a data 

switching device to each of a plurality of flow pipes, 
comprising: 

allocating to the plurality of flow pipes a maximum 
bandwidth which is a function of the available bandwidth 
10 of the data switching device; 

allocating to each of the plurality of flow pipes a 
maximum bandwidth which is a function of the bandwidth 
allocated to the plurality of flow pipes; and 

ensuring that the bandwidth through the data 
is switching device consumed by a flow pipe is no greater 
than the maximum bandwidth allocated to the flow pipe. 

39. In an Internet Protocol network, a method for 
selecting a best-fit server, from among a plurality of 
servers, to service a client request for content, the 

20 method comprising: 

identifying a location of the client; 
identifying a location of each of the plurality of 
servers; 

identifying servers that are in the same location as 
25 the client; and 

selecting as the best -fit server a server from among 
the plurality of servers using a process which assigns a 
proximity preference to the identified servers. 

40. The method of claim 1, further comprising 

30 determining whether an active path exists between the 
client and the best- fit server. 

41. The method of claim 40, wherein determining whether 
an active path exists comprises sending a PING packet to 
the client. 
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42. The method of claim 40, wherein determining whether 
an active path exists comprises performing a Border 
Gateway Protocol route table lookup. 

43. The method of claim 40, wherein the location of the 
5 client comprises a continent in which the client resides. 

44. The method of claim 43, wherein the locations of the 
plurality of servers are continents in which the servers 
reside. 

45. The method of claim 40, wherein identifying servers 
10 that are in the same location as the client comprises: 

identifying administrative authorities associated 
with the client; 

identifying, for each of the plurality of servers, 
administrative authorities associated with the server; 
is and 

identifying servers associated with an 
administrative authority that is associated with the 
client . 

46. The method of claim 45, wherein the administrative 
20 authorities are Internet Service Providers. 

47. A system for directing a flow between a client and a 
best -fit server, the system comprising: 

a plurality of servers; 

a flow switch coupled to the plurality of servers by 
25 an Internet Protocol network through one or more 

communication links, wherein the flow switch comprises: 

means for receiving a client request for content via 
the Internet Protocol network; 

means for deriving, from the client request, content 
30 type information descriptive of the type of content 
requested by the content request; 

means for deriving, from the client request, quality 
of service information descriptive of quality of service 
requirements of the content requested by the client 
35 request; 
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means for selecting as the best -fit server a server 
from among a set of candidate servers serving the content 
requested by the client request, based on the content 
type information, the quality of service information, and 
5 a combination of server metrics descriptive of expected 
qualities of service provided by the candidate servers 
when serving the requested content; 

means for subsequently forwarding to the best -fit 
server transmissions originating from the client which 
10 are associated with the client request for content; and 

means for subsequently forwarding to the client 
transmissions originating from the best -fit server which 
are associated with the client request for content . 

48. The system of claim 47, wherein: 

is the candidate servers comprise HTTP servers. 

49. A flow switch in an Internet Protocol network, 
comprising : 

means for receiving a client request for content via 
the Internet Protocol network; 
20 means for deriving, from the client request, content 

type information descriptive of the type of content 
requested by the content request; 

means for deriving, from the client request, quality 
of service information descriptive of quality of service 
25 requirements of the content requested by the client 
request ; 

means for selecting as the best -fit server a server 
from among a set of candidate servers serving the content 
requested by the client request, based on the content 
30 type information, the quality of service Information, and 
a combination of server metrics descriptive of expected 
qualities of service provided by the candidate servers 
when serving the requested content; 
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means for subsequently forwarding to the best -fit 
server transmissions originating from the client which 
are associated with the client request for content; and 

means for subsequently forwarding to the client 
5 transmissions originating from the best-fit server which 
are associated with the client request for content . 



WO 99/06913 




PCT/US98/11912 



FIG. 1a 



1/26 



R5 




^- Router 



WO 99/06913 



PCT/US98/11912 



2/26 



FIG. 1b 




WO 99/06913 



PCT/US98/11912 



3/26 



FIG. 1c 




Response 
traffic flow 



165a 



_- Conient-Aware i— JJ, 



110 

Z-UOa 155a 

H > 

yUQb 1 



55b 



100c 



Web Server 




Flow Switch ^170c 155c 



Content request 
105c traffic flow 



160 

J 



o 

3 

i 

C/3 
Q. 

CD 



i 



WO 99/06913 



PCTAJS98/11912 



4/26 



FIG. 2 



200 



Data Plane 



i 

▼ 



Control Plane 



202 



Intelligent 
Content Probe 
(ICP) 



Internet Probe 
Protocol 
(IPP) 



Internet 
Proximity Assist 
(IPA) 




206 



Content Server 
Database 
(CSD) 



204 



222: 



^4 



212 



Web Flow 
Redirector 
(WFR) 



211 



216 



220 



Client 
Capability 
Database 
(CCD) 



Flow ! 218 
Admission 
Control 
(FAC) ; 



0) 

c 

J2 
CL 

c 

Q) 

E 

0) 
O) 
CO 

c 



WO 99/06913 



PCTAJS98/11912 



5/26 



FIG. 3 



Client content 
request arrives 



402 



400 



Query CSD for 
available servers 
(FIG. 4) 



404 



Redirect flow to 
remote server 



Spoof TCP 
connection 




408 




Ask FAC to 






assign flow to 






local server 






(FIG 


- 17) 






r 



412 



Set up network 
address translation 



416 



Reject flow with 
appropriate error 



i 



'Connect' to 
appropriate server 



426 

U 



1 



r 



Done 



Forward content 
request to server 
as appropriate 



428 



WO 99/06913 



PCT/US98/11912 



6/26 



FIG. 4 



404 



Parse content 
request 



429 



430 



Query database for! — ^ 

servers serving 
requested content 




Query CCD for 
available client I 
information 




Assign value to 
Status according 
to FIG. 5 



Create new 
record using 
default data 



452 



Ask ICP to get 
better data for 
future requests 



451 



WO 99/06913 




PCT/US98/11912 



7/26 



FIG. 5 



442 



454 




Yes 



1 


f 


Attempt to locate 


client in 'stuck' pool ! 

i 




' 458 



456 




Yes 



List contains only j 


one server j 




r 


Status = 


ACCEPT 



460 



462 



464 



Status = REJECT 



466 



WO 99/06913 



PCT/US98/11912 



8/26 



FIG. 6 



456 



Evaiuate requested content 
(FIG. 7) 



468 



1 



Filter candidate server list and order 
remaining candidate servers 
(FIG. 8) 



470 



Assign proximity preferences to 1 
remaining servers 
(FIG. 22) 



472 




WO 99/06913 



PCT/US98/11912 



9/26 



FIG. 7 



| Recalculate avglnterval 


494 


i 

r 


-Yes— 



burstLength 


= 0 






486 






/ 


requestFiag 


= 0 




WO 99/06913 



PCT/US98/11912 



10/26 



FIG. 8 



514 

J_ 

Select first server in list 



526 




Yes-H 



520 



Select next server \ 
in list 



i j Evaluate server 
(FIG. 10) 



522 



Apply ordering rules 
(FIG. 11) 



518 

J- 



Remove server from 
candidate server list 



Yes 




No 

A 528 




WO 99/06913 



PCTAJS98/11912 



11/26 




WO 99/06913 



PCT/US98/11912 



12/26 



FIG. 10 




serverFlag = RECENT OTHER ! 

~ i 




— No- — <J*ECENT_OTHER?J>-Yes* serverFlag &= l_OW_CACHE 



WO 99/06913 



PCT/US98/11912 



13/26 



FIG. 11 




Server is not optimal 



WO 99/06913 



PCT/US98/11912 



14/26 



FIG. 12 




No 





604 




606 










Status : 


- OKAY ' 

i 


Status = NOT_OPTIMAL • 




— *( Done 





WO 99/06913 



PCT/US98/11912 



15/26 




WO 99/06913 



PCT/US98/11912 



16/26 



FIG. 14 




No 



No 





642 

/ , 




Status = 


= OKAY | 






f 


644 



Done 



Status = NOT OPTIMAL 



WO 99/06913 



PCT/US98/11912 



17/26 



FIG. 15 





WO 99/06913 



PCT/US98/11912 



FIG. 16 



18/26 



666 



668 




1 




678 

y 


Status = OKAY 





c 



Done 



J* 



- Status = NOT OPTIMAL 

i - i 



WO 99/06913 




PCT/US98/11912 



19/26 



FIG. 17 



408 



Fetch record for first server in 
candidate server list 



684 




WO 99/06913 



PCT/US98/11912 



20/26 



FIG. 18 



690 



726 



Determine ingress i 
and egress ports i 



728 



Construct QoS tags 
(FIG. 19) 



730 




734 



Assign flow to flow pipe 



732 



1 


Assign flow to VC pipe 




736 










Done 



WO 99/06913 



PCT/US98/11912 



21/26 



FIG. 19 



728 



738 




742 



Find minimum bandwidth MinBW 




746 



Yes~* burst tolerance btol 



Find peak bandwidth PeakBW 



Find buffer requirements Buffers 



A. 



Construct QoS Tag from Buffers 
and MinBW 



754 



760 



Done 



Find all similar 
QoS tags 
(FIG. 20) 



WO 99/06913 



PCT/US98/11912 



22/26 



FIG. 20 



754 




Yes- 



Find all existing QoS 
tags with higher MinBW 
and lower Buffers 



768 




Find ail existing QoS tags 
with lower MinBW and 
higher Buffers 



Yes- 



772 



For each QoS tag: 
i- Calculate average bandwidth 
!- Calculate new TCP window size 
j- Verify TCP window is at least 4K 



For each QoS tag, verify that Buffers j 
= (PeakBW - MinBW) • btol 



Done 



WO 99/06913 



PCT/US98/11912 



23/26 



FIG. 21a 



WOd 



110 



Content-Aware Flow Switch 



100a 



Web Server ^ 



100e 



CD 
"O 

o5 

i 

v- 

O 

en 



Web Server 



100c 

J 



Web Server 



100f 




WO 99/06913 




PCT/US98/11912 



24/26 




WO 99/06913 



PCT/US98/11912 



25/26 



FIG. 22 

800 



Identify continental 
location of client 




Identify continental locations of 
candidate servers 




Don't assign 
proximity preference . 
to any server y 



Prune list of servers to those 
in same continent or unknown i 



810 



Assign proximity 
preference to 
server in same 
continent as client 



i 



H— No 



818 




Yes- 



812 
J. 



Look up client AS 



Assign proximity 
preferences to 
identified servers 



Identify servers with 
AS's assigned to same 
ISP as any client AS 



814 



Look ud server AS's 



820 



V rifypath 
between client and 
preferred server(s) 



822 



Place preferred 
servers at top of 
candidate server list 



WO 99/06913 



PCT/US98/11912 



FIG. 23 



1010 



REMOVABLE 
DISK DRIVE 



I/O INTERFACE 



7020^ 



26/26 



1030 



DISK DRIVE 
CONTROLLER 



I 



MASS STORAGE 
INTERFACE 



1050 



1040 



I/O BUS 



1080 



PROCESSOR 



7090 
^ 



I/O CONTROLLER 



1100 



CPU BUS 



1110 



RAM 



ROM 



7720 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US98/1I912 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC(6) :G06F 13/00 

US CL 395/200.33, 200.56. 200.59. 200.53. 200.54 
According to International Patent Classification (IPC) or to both national classification and IPC 

E FIELDS SEARCHED 

Minimum documentation searched (classification system followed by classification symbols) 

U.S. : 395/200.33, 200.56. 200.59. 200.53, 200.54 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



US 5,341,477 A (PITKIN et al) 23 August 1994, col. 2, lines 35- 
68, col. 3, lines 1-60, col. 4, line 15 to col. 11, line 45. 

US 5,459,837 A (CACCAVALE) 17 October 1995, col. 1-2, col. 3, 
line 55 to col. 9, line 63. 

US 5,475,819 A (MILLER et al) 12 December 1995, see the whole 
reference. 

US 5,230,065 A (CURLEY et al) 20 July 1993, see the whole 
reference. 

US 5,031,089 A (LIU et al) 09 July 1991, see the whole reference. 



1, 5-10, 12-33, 
37, 39-44, 47-49 

1, 5-10, 12-33, 
37, 39-44, 47-49 

1-37,39-49 



1-37,39-49 
1-37,39-49 



Further documents are listed in the continuation of Box C. £^ See patent family annex. 



■E' 



Special categories of cited documents: 

document defining the general state of the art which is not considered 
to be of particular relevance 

earlier document published on or after the alternation*] filing date 

document which may throw double on priority claixn(i) or which is 
cited to establish the publication date of another citation or other 
special reason (at specified) 

document referring to an oral disclosure, use, exhibition or other 
means 

document published prior to the mtematiotul filing date but later than 
the priority date claimed 



teter document published after the intemauonal filing date or priority 
date and not in conflict with the tppUcation but cited to understand 
the principle or theory underlying the invention 

document of particular relevence; the eleimed invention cannot be 
considered novel or cannot be considered to involve en inventive step 
when the document is taken clone 

document of particular relevence; the olatmed invention cannot be 
considered to involve an inventive step when the document is 
combined with one or more other such documents, such combination 
being obvious to e person skilled in the art 

document member of the same patent family 



Date of the actual completion of the international search 



10 SEPTEMBER 1998 



Date of mailing of the^ international search report 



18 NOV 1998 



Name and mailing address of the ISA/US 
Commissioner ofPatents and Trademarks 
Box PCT 

Washington, D.C 20231 



Authorized officer 
ZARNI MAUNO 




INTERNATIO 



SEARCH REPORT 



International application No. 
PCT/US98/11912 



C (Continuation). DOCUMENTS CONSIDERED TO BE RELEVANT 



Catcgoiy* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



US 5,249,290 A (HEIZER) 28 September 1993, see the whole 
reference. 

US 5,574,861 A (LORVIG et al) 12 November 1996, col. 7, line 
11 to col. 9, line 65. 

US 5,475,685 A (GARRIS et al) 12 December 1995, col.2, lines 
20-34, col. 4, line 59 to col. 5, line 54. 

US 5,701,465 A (BAUGHER et al) 23 December 1997, see the 
whole reference. 

US 5,673,393 A (MARSHALL et al) 30 September 1997, see the 
whole reference. 



1-37, 39-49 



38 



38 



38 



38 



INTERNATI 



SEARCH REPORT 



ational application No. 
PCT/US98/11912 



Box I Observations where certain claims were found unsearchable (Continuation of item 1 of first sheet) 



This international report has not been established in respect of certain claims under Article I7(2Xa) for the following 
I. Q Claims Nos.: 

because they relate to subject matter not required to be searched by this Authority, namely: 



reasons: 



□ 



Claims Nos.: 

because they relate to parts of the international application that do not comply with the prescribed requirements to such 
an extent that no meaningful international search can be carried out, specifically: 



3. Q Claims Nos.: 

because they are dependent claims and are not drafted in accordance with the second and third sentences of Rule 6.4(a). 



Box II Observations where unity of invention is lacking (Continuation of item 2 of first sheet) 



This International Searching Authority found multiple inventions in this international application, as follows: 
Please See Extra Sheet. 



|~x| As all required additional search fees were timely paid by the applicant, this international search report covers all searchable j 



claims 



2- Q As all searchable claims could be searched without effort justifying an additional fee, this Authority did not invite payment ] 
of any additional fee. 

3. As only some of the required additional search fees were timely paid by the applicant, this international search report covers 

only those claims for which fees were paid, specifically claims Nos.: 



4. j | No required additional search fees were timely paid by the applicant Consequently, this international search report is 
restricted to the invention first mentioned in the claims; it is covered by claims Nos.: 



Remark on Protest 



| [ The additional search fees were accompanied by the applicant's protest. 
| | No protest accompanied the payment of additional search fees. 



Form PCT/ISA/2I0 (continuation of fir«t «Wtmvi»lv ioooy* 



interna™ 




L SEARCH REPORT 




n^roational application No. 
PCT/US98/11912 



BOX II. OBSERVATIONS WHERE UNITY OF INVENTION WAS LACKING 
This ISA found multiple inventions as follows: 

This application contains the following inventions or groups of inventions which are not so linked as to form a single 
inventive concept under PCT Rule 13.1. In order for all inventions to be searched, the appropriate additional search fees 
must be paid. 

Group I, claims 1-37 and 39-49 are directed to a method and system for directing a flow between a client and a best-fit 
server. 

Group II, claim 38 is directed to a method for allocating bandwidth of a data switching device. 

The inventions listed as Groups I and II do not relate to a single inventive concept under PCT Rule 13.1 because, under 
PCT Rule 13.2, they lack the same or corresponding special technical features for the following reasons: 

Group I, claims 1-37 and 39-49 contains the special technical features for directing a flow between a client and 
a best-fit server. 

Group II, claim 38 contains the special technical features for allocating bandwidth of a data switching device. 



r orT/TCA/ltn fk M «Vl.il«# iooo\+ 



ADXUA 



Descripti n 


Date— 














AH Meters — 
















Thr 


Fault Cd 


Loc_ 


1 


2 


3 


4 


5 


Loc 


PHft faded setf-test 


2 


H0 15 
J144.J145H017 


MQL ... 


i 










003L 




2 


J146.JU7 H018 


004L 


i 










C04L 




2 


J148J149 H019 


005L 


\ 










£05L 




2 


J023.J1SSJ189 


006L 


t 










006L 




. 2 


J155J156L020 


007L 












007L 




2 


H014 


008L 














008L 


H.V. Faults 


















1009L 




_5_ 

5 


P0S9 
P060 


010L 












1 010L 




5 


J061 


O'M 














w" 




5 


P062 


012L 














01 2L 




5 


F063 


013L 














01 3L 




5 


F064 


0141. 












•NAMH? 


014L 




5 


F065 


015L 














01 5L 




5 


J067 


016L 














0161 




5 


F06S 


017L 














01 7L 
























S . 

5 


N/A 

ivn 


018L 
019L 






/ 













5 


N/A 


020L 


















5 


N/A 


021L 














rrxn 




5 


N/A 


022. 


















S 


L ■ " WA 


023L 


















3 


N/A 


024L 














FrCl 














2 


J028 


Q2SL . , 








02SL 


T - ? '*' v "* IT * — * 


■5 


H02? 


0271 








0?7Lj 




2 


F137 


02$L 














C28lJ 




5 


F004 


029L 














029L 




5 


F005 


030L 














030L 




5 


F006 


031L 














031 L 




S 


F007 


032L 














*wn 




5 


F008 


033L 


















5 


RX)9 


034L 














Ed 




' 5 


F010 


035L 














EES! 




5 


F011 


036L 


















5 


F012 


037U 


















15 


F087 


038L 


















35*0 


N/A 


039L 
















failed to reenase in 30 rev. 


5 


F135 


040L 












I040L 


Document Hindi tr Faults 








Side Mr. late to Dfti^enff^ 


10/20 


A2M__ 


042L 












EOT 


Side fdr. tattoff D*n. •ntr.~ 


10 


A212 


043L 












ESI 




10 


A213 


044L 














E3 




10 


A214 


045L 














EES 


Ptaten dame ftuMi 


5 


A19O.A225 A206 


046L 














ESI 


Inout nio fauts 


5 


A222.A224 


047L 














Ed 




10 


A218 


04BL 












I 048LI 




10 


A208 


049L 








-+\ 






EMI 




15 


A193 


ospu 






4 










Tor *<1* 'are t*v exit fN-n 


10 


A070 


051L 






_j 






I 05 1 '-J 




ifi_ 


A200 


052L 


















10 


A 194 


053L 






i 






M^a^fcM 


ESI 




10 


A192 


054L 












H^aWHiW 


EES 




10 












/ 




MBa^HB 


ess 




10 


A195 


056L 










n^a^Mi 


EES 


Too fdr tate to trav entr. 


5 


A196 


057L 




I 












5 


A197 


0S8L 












058L.I 




10 


A201.A237 


059L 






H 






059L f 




10 


A202 


060L 












0601, • 




5 


A016.A013 


061L 












06 H. 




10 


A072 


062L 












062U_ 




10 








— t 








063L, 



Ths Threshold between calls is 90K for 5892 and 60K for 5680 



~ Ths Thrtshold is 20 f r Systsms with ! 



300U/*JQ94V fc*w __.*# — • - w 



AOXUA 



Descripti n 



Date 



AH Meters — 



Self - Test Faults 



Thr 



Fault Cd 



!_____- 



Loc 



rrtM team «MM«t 



-H015 



m_ 



PHR faded setf-test 



J144.J145 H0 17 



Q03L 



0031, 



MIR failed sert-iest 



J146.J1A7 H018 



004L ... 



C04L 



XER failed self-test 



J148,J149HQ19 



_________ 



:osl 



ISR failed serMest 



J023.J1B8 J189 



006L 



006L 



FOR failed self-test 



J1S5.J1S6I.020_ 



007L 



007L 



Shared line failure 



008L 



008L 



H.V. Faults 



AC wniwaeteuit 



_________ 



OPS-. 



__£2L 



A lCharoe *2 voltage fault 



F060 



01 PL 



01 PL 



'ransrer current rauit 



J061 



_0_L. 



Preclean current fault 



FQ62 



_0_2L. 



01 2L 



Deveiooer bias fault 



F063 



J_3L. 



0131 



Toner bias fault 



F064 



014L 



•NAME? 



014L 



Cleaner bias fault 



F06S 



01SL 



Waste roll bias fault 



J067 



01 6L 



01 6L 



Are detector fault 



F068 



017L 



017L 



System 



Errors 



Q18U 



avstcm error nam 



019L 



System crrpf (PHR) 



N/A 



02OL 



020L I 



Svsttm error (MIR) 



N/A 



_021L. 



System error fXER) 



N/A 



System error (FOR) 



N/A 



023L 



Power loss in print 



N/A 



0241 



Timing Faults 



Timing nwif faults 



_J22_L 



_2fiL_ 



i22SL 



H029 



02T. 



Too many Oeft holes 



F137 



028L 



COM lost machine docks 



F004 



029L 



029LI 



MIR lost machine docks 



FOOS 



030L 



030L 



XER lost machine docks 



F006 



031L 



031L 



PHR test machine docks 



F007 



032L 



22L 



COM lost pitch resets 



F008 



033L 



0331. 



MIR tost pitch resets 



03*- 



XER tost pitch resets 



F010 



035L 



Registration finger faults 



F011 



-___&- 



ISR lost pitch resets 



F012 



037L 



Not readv >n 1 2 sec. 



F087 



038- 



No. of reohastno cydes* 



35*0 



N/A 



03 9L 



Failed to reonase 30 rev 



F13S 



040L 



I 04QC 



Document Handler Faults 



Sf_s'flr taieiQPtip.gntr." 



^_U_L 



_______ 



Side fdf. lateoff ptn. entr** 



A212 



Side tdr.iatetopfcn.egt 



10 



A213 



0441 



Side Mr. late off pertex* 



10 



A214 



04SL 



Ptaten damp faults 



A190A225 A206 



046L 



T046LJ 



Input nip faufcs 



CFF hole faun* 



10 



A21S 



-2_2L_ 



048L 



CFF servo faults 



10 



A206 



049L 



B Top fdf lata to tray men 



15 



A193 



OSOL 



Tr~ M » 'at e tin exit (HA) 



Top fdr ate oft tray exit tinv) 



10 



AQ70 



05iL 



10 



A200 



0S2L 



"1 05 _J 



Top fdr late to Platen Entrance f KM) 



10 



A194 



053L 



Top fdr late to Platen Entrance f Inv) 



10 



AIM 



0*1 



Top fdr. ate oft pftn. entr 



10 



A069 



B Top fdr. late to ottn. exit 



10 



_A_*_ 



B 



Top fdr late to trav enrr. 



A196 



057L 



Too fdr late erf :rav entr. 



A197 



058L 



Top fdr miscounts 



10 



A201.A237 



0591 



± 



059k 



To^_fdbr_wjtteed_ w 



10 



A202 



060L 



Doc hander shutter fault 



A016>013 



061L 



o6og p 



061L 



Too for set seoentor misfiia 



10 



A072 



CFF 1 M form off-feed faun 



10 



A228 



_06&_ 



063L 



4- 



062L 



063L 



The Thresh Id betwe e n calls is 90K for 5892 and 60K for 5680 



~ The Threshold is 20 f r Systems with Side Feeder 



ooou/;jo<?*. ..... — ^ 



ACI\U/\ 



Descripti n 



Date 



AH Meters — 



Self - Test Faults 



Thr 



Fault Cd 



Loc 



OQQL 



003L 



PHR failed sett-test 



J144.J145HQ17 



003L 



MIS failed serf-test 



JU6.JU7 H0 18 



0O4L 



C04L 



XER failed setMes: 



J14A.J149 H019 



0O5L 



005L 



1SR failed setMest 



JQ23.J188 J1B9 



006L 



006L 



FOR failed setf-test 



J1SS.J1S6L020 



007L 



007L 



Shared line failure 



HQ14 



0O8L 



0Q8L 



H.V. Faults 



p«9 



0Q91 



Charge *2 voltage fault 



F060 



0101 



01 PL 



Transter current fault 



J061 



Preciean current fault 



F062 



01 2L 



012L 



Developer bias fault 



F063 



01 3L 



01 3L 



Toner bias fault 



FOfr* 



0141 



»NAME? 



01 4L 



Cleaner bias fault 



_F065_ 



01 SL 



01 SL 



Waste roll bias fault 



J067 



016L 



01 6L 



Arc detector fault 



F068 



017L 



017t 



System Errors 



■SYMflmcrfyfCW) 



JUL. 



a v si em error m 



01&L 



System error (PHR) 



N/A 



System error (MIR) 



N/A 



02 1L 



System error (XER) 



N/A 



022L 



Svsttm error (FOR) 



N/A 



0231 



Power toss in print 



N/A 



0241 



Timing 



Faults 



Timing r 



t fauns 



JQ28 



026L 



£2fiL 



^e't h?f»g 



M029 



02T. 



027U 
028l| 



Too many ben holes 



F137 



028L 



COM lost machine docks 



F004 



Q29L I 



MIR lost machine clocks 



F005 



030L 



XER lost machine docks 



F006 



031L 



PHR tost machine docks 



FOOT 



0321 



COM lost pitch resets 



F0O8 



033L 



MIR tost pitch resets 



_F0C£_ 



0^- 



XER tost pttcn resets 



F010 



035L 



Registration finger faults 



F011 



ISR lost pitch resets 



F012 



0371 



Not readv m 12 sec. 



No. of repnasino cvdes' 



Failed to reonase in 30 rev. 



F087 



1 » I 



N/A 



F13S 



040L 



I 040L 



Document Handler Faults 



1Q/2Q 



A21 1 



042L 



Side fdr. lateoff otn. entr.' 



JO. 



A212 



_043L_ 



Side fdr. late to otn.egt 



10 



A213 



Side Mr. late off pun-eat 



10 



A214 



04SL 



Platen damp fautta 



A190.A225 A206 



046L 



Input nio fauH 



A222.A224 



J2L 



CFF note fault* 



10 



A218 



048L 



CFF servo fauftl. 



10 



A208 



049L 



7SZ 



B Too fdr late to tray eat 



13 



A193 



OSOL 



To; if* 'ate >)* *r*v exit iHA\ 



Too fdr tate oft tray e»t tiny) 



10 



A070 



051L 



10 



0S2L 



I OS 1 '- J 



Too fdr late to Platan Entrance (N-l) 



A194 



_053L_ 



Top fdr late to Platen Entrance (Inv) 



10 



A192 



J82L. 



Too fdr. late off ottn. entr 



10 



A069 



0S5L 



B 



Top fdf. late to ottn. exit 



JL2- 



A19S 



.050. 



Too fdr late to trav entr. 



A196 



057L 



B 



Too fdr late erf rrav entr. 



A197 



058L 



C58L 



Top fdr miscounts 



10 



A201.A237 



0S9L 



± 



0S9L 



Too fdr muttif eeds 



_12_ 



-2t&_ 



Dee hinder tWutttf fault 



A016.A013 



061 L 



061L 



Toe far it: stoeraior maiiio 



J2- 



A072 



4- 



;FF i" form ofMeed fault 



10 



A228 



063L 



The Threshold between cells is 90K for 5892 and 60K for 5680 



- The Thresh Id is 20 f r Systems with Side Feeder 



AOVJA 



Descripti n 


Date- 














AH Meters — 
















Thr 


Fault Cd 




1, 


2 


3 






Loc 


rr>M failed MiNwat 




N015 
















PHR failed setf-test 


2 


J144.J145 H017 


003L 












003L 


MIR tailed sert-tcst 


2 


J146.J147 H018 


0O4L 


i 










COAL 


XER failed self-test 


2 


J14SJU9 H019 


0O5L 


1 










C05L 


ISR failed sett-test 


2 


J023J188 J 189 


006L 


i 










006L 


FOR fatted sefMesi 


2 


J15SJ156L020 


007L 


l 












007L 




2 


H014 


008L 














008L 


H.V. Faults 






















s „ 


F059 


0O9L 














0O9L 




5 


F06O 


01 0L 














010L 


X Transfer current rault 


5 


J061 


01 1L 












i Z ■ *L 




5 


F062 


01 2L 














01 2L 




5 


F063 


013L 














01 3L 




5 


F064 


014L 












•NAME? 


01 4L 




5 


F065 


015L 














015L i 




5 


J067 


016L 














01 6L i 




5 


F068 


017L 














0171 j 




















Sv«mm #fTOffCOM> 


s 


N/A 


013L 


















5 


ivA 


01 9L 






/ 








C* SL 


Svstem error (PHR1 


5 


N/A 


020L 














020L 






N/A 


MIL 














021L 






N/A 


022. 


















5 


U , ' WA 


023L 


















3 ' 


N/A 


024t 












1 0241 


Timing Faults 














T^ing rwcfaute 


— 2-J 




026L 








— -4- — 




JQ2&L 


Tec *ewt;e!t 


** 


M029 


027L 












mi 




2 


F137 


028L 














028L| 




5 


F004 


029L 














029L I 




5 


F005 


030L 


















5 


Fooe 


031L 


















5 


FOOT 


032L 


















5 


F008 


033L 














I?<?1 




5 


F009 


0?4t 


















5 


F010 


03?L 














eeei 






F011 


0?6L 


















5 


F012 


037L 
















Not readv m 12 sec. 


IS 


F087 


038V 














ESI 


No. of reohasma cvdes* 




N/A 


039L 














EESI 


Failed ro reonase m 30 rev. 




F135 


040L 












(040L 


Document Handler Fautts 












Side tor law to elm. entr ** 




A211 


042L 














Rwl 


Side tdr. tatcoff otn, entr." 


1 Q 


A212 


043L 












aaaaaVaaaaTJ 


P!E1 


Side fdr. late to otn.ent 


10 


A213 


044L 












BaaaaaaaaaaV 


EH 


Side fdr tate off ottrvexxt 


10 


A214 


045L 














ESI 


Platen dame fautts 


s 


A190.A22S A206 


046L 














EE! 




s 


A222.A224 


047L 












avaTaaaaaaaaTJ 


Ed 


CFF hole faults 


10 


A218 


046L 












■■■■ 


ESI 


CFF servo faults 


10 


A208 


049L 












■esaaaaaM 


EE! 


Too fdr late to trav est 


15 


A 193 


050L 






4 






■■■■■ 


ESS 


Tec '1* tsv exit (N-4> 


10 


A070 


051L 






-j 






1 0511 1 


Too fdr ate oft trav exit dnv) 


10 


A200 


052L 












HaHHal 






10 


A194 


053L 






i 






HaaaaTeaTJ 






10 


A192 


054L 






i 






aaaTeaa^aaafl 






10 


A069 


055L 












LaaVeaiaaVI 




Too fdr. late to ottn. exit 


10 


A195 


056L 










■■■■11 




Too fdr late to trav entr. 


5 


A196 


0S7L 




i 






BeaflaaaV 


gszi[ 


Too fdr late eff xtv entr. 


5 


A197 


0S8L 












C58L B 




10 


A201.A237 


059C 












059L B 




10 


A202 


060L 






-it- 






0601, * 




5 


A016.A013 


061L 














Too far set seoerator misilio 


1C 


A072 


062L 












362L 




10 








— * — 








063L 



The Threshold between calls is 90K for 5892 and 60K for 5680 



~ The Thresh Id is 20 for Systems with Side Feeder 



Descripti n 



ADXUA 



AH M ters - 



Self - Test Faults 



Thr 



Fault Cd 



Loc 



HQ 15 



PHR fatted safest 



J144.J145 H017 _ 



Q03L 



003L 



MIR tailed serf-test 



J146.JU7 HQ18_ 



004L 



C04L 



XER failed sctMcst 



J148.J1A9H019 



OOSL 



COSL 



ISR failed self -test 



J023J188J189, 



0Q6L 



006L 



FOR failed setMest 



J15S.J1S6L020_ 



007L 



007L 



Shared line failure 



HQ14 



008L 



0081 



H.V. Faults 



AC i/niMcefauit 



J2QSL. 



Charge «2 voitaoe fautt 



F060 



01 PL 



OfOL 



ranster current rauli 



J061 



Preclean current fautt 



FQ62 



012L 



01 2L 



Developer bias fault 



F063 



013L 



01 3L 



Toner bias fault 



Cleaner bias fauft 



F064 



014L 



F06S 



01SL 



»NAME? 



Q14L 



01SL 



Waste roll bias fault 



JQg7 



016L 



01 6L 



Arc detector fautt 



F068 



017L 



0171 



System 



Errors 



System error (COM! 



018L 



018L 



avstem error nam 



019L 



System error (PHR) 



N/A 



020L 



020L 



System error (MIR) 



N/A 



-221k. 



System error (XER) 



N/A 



022L 



System error (FOR) 



N/A 



023L 



N/A 



0241 



Timing Faults 



Timing reset faults 



J22SL 



Q26L 



Tc? *e'.v *e't 



HQ29 



02T- 



02711 
028lj 



Too many belt notes 



F137 



028L 



COM lost machine docks 



FOO* 



029L 



029LI 



MIR lost machine clocks 



FOOS 



030L 



03* 



XER lost macnine docks 



FOOS 



031L 



031 L 



PHR tost machine docks 



FOOT 



032L 



COM tost pitch resets 



F0Q8 



_0^_ 



MIR tost pitch resets 



FOOS 



034L 



XER tost pitch resets 



F010 



_035L_ 



Reoistratton finger faults 



FOII 



-SSL. 



SR lost Pitch resets 



F012 



0371 



Not readv in 12 sec. 



F0S7 



038L 



No. of reonasinq cvdes* 



3SV90 



N/A 



03* 



Failed to reonase in 30 rev. 



F13S 



Q4QL 



1040L 



Document Handler Faults 



Sirtstor tatnTftPtm entr" 



Q42L 



Side fdr. lateoff pen, entr." 



J2. 



A212 



043L 



Side fdr. tate to ptn.ewt 



10 



A213 



Side fdr. late off p*n.eat 



10 



A214 



045L 



Platen damp faults 



A190.A22SA206 



046L 



tnoul nip fautt 



A222.A224 



047L 



CFF hole fauta 



10 



A218 



048L 



04^ 



CFF servo fauftj 



10 



A208 



049L 



049L 



B Too fdr lata to trey tact 



15 



A193 



OSOL 



OSOL 



Tn; 'at e o*f *niv exit (N-0 
Too fdr ate oft trav exit «inv) 



10 



A070 



051L 



10 



A200 



0S2L 



05 1'- 



Too fdr tate to Platen Entrance (N-0 



10 



A 194 



0S3L 



Too fdr late to Platen Entrance f Inv) 



10 



A192 



P^H- 



Too fdr. tate off pftn. entr 



10 



OS* 



B Too fdr. late to pftn. exit 
B iTop fdr late to tray entr. 



J0- 



A195 



0S6L 



A196 



0571 



Too fdr late off rrav entr. 



A197 



0S8L 



B 



Too fdr miscounts 



10 



A201.A237 



0S9L 



1 



Top^drjryjtjfeeds^ 



10 



A202 



See handler shutter fauH 



A016.A013 



061L 



ToeiL 



'oo for set seoerator misiiio 



10 



A072 



CFF 1" form off-feed fautt _ 



10 



A228 



063L 



The Threshold between calls is 90K for 5892 and 60K for 5680 



- The Threshold is 20 f r Systems with Side Feeder 



3UOU/*IQ?4^ h*w — ■ . - w 



Descripti n 


















AHM t rs- 
















Self - Test Faults 


Thr 


Fault Cd 


- Loc 


1 




3. 


4 


s 


Loc 




qqm faHta sanest 


2— 


MOTS — 


OWL 












.m 




PHR faded self-test 


. 2 


J144.J145 H0 17 


0O3L 












003L 




MIR failed seiMest 


2 


J146.J147 H018 


0O4L 












0041 




XER failed serf-test 


2 


J148.J149 H019 


0O5L 














C05L 




ISR failed self-test 


2 


J023.J1B8 J 189 


006L 














006L 




FOR failed setMest 


2 


J155.J156L020 


0O7L 














0O7L 




Shared line failure 


2 


H0 14 


008L 














1 0081 




H.V. Faults 






A AC voitaeefauH _ 


s 


pom 


0O9L_ 


I 














A Charae «2 voitaae fault 


5 


F060 


010L 












010L 




A T.-ansrer current rauii 


5 


J061 


C11L 


















A Preclean current fault 


S 


(=062 


01 2L 














012L 


A 


A Developer bias fault 


5 


F063 


013L 














01 3L 


A 


A Toner bias fault 


5 


F064 


014L 












(NAME? 


01 4L 


A 


A Cleaner bias fault 


5 


F06S 


01 5L 














oi a. 


A 


A Waste roll bias fault 


5 


J067 


016L 














01 6L 


A 


A Arc detector fauft 


5 


F068 


017L 














017L 


A 


System Errors 






Sv«rem error (CDM) 


5 


N/A 


018L 


















Svstem error uSnp 


5 




019L 






/ 












Svstem error (PHR) 




N/A 


020L 














Evil 


Svstem error fMIR) 


5 


N/A 


021L 














Frill 




5 


N/A 


0??1 














■>?<*■] 


Svstem error (FOR) 


5 


- N/A 


023L 
















Power toss in ohm 


3 


" ' N/A 


024L 
















Timing Faults 




Ttmina r#s#t faults 


2 | 




- Q2fiL 














J228L 


Tc? 'e*.v *f»>t *ic'»$ 




"029 


02TL 














027U 


Too manv ben holes 


2 


F137 


028L 














02?L| 




COM lost machine clocks 


5 


F004 


029L 














Q29C l 


MIR lost machine clocks 


5 


F005 


030L 
















B 


XER lost machine docks 


5 


F006 


031L 














i^m 


PHR lost machine docks 




FOOT 


032L 
















COM lost Ditch resets 


5 


F0O8 


















MIR lost oitch resets 


.5 


F009 


0$*L 














P3H 


XER lost oitch resets 


5 


F010 


035L 














EES 


ReciAtration finoer faults 


-5 


F011 


036L 
















ISR lost pitch resets 


5 


F012 


037L 
















Not readvin 12 sec. 


<5 


F087 


038L 












mmmm 


EES 


No. of reohasina cycles ' 


35/90 


N/A 


039L 












BBBBBBl 


ESI 


Failed to reonase in 30 rev. 


S 


F135 


040L 












I 040L 


Document Handler Faults 




Side fdr tatetoofm. entr" 




A211 


042L 












aWHHi 




Side fdr. tateoff oftn. entr.** 


10 


A212 


043L 












■HUHa 1 ! 




Side fdr. late to otn.est 


10 


A213 


044L 














E2S 


Side fdr late off o*n.est 


10 


A214 


045L 














ESS 


Platen damo faults 


5 


A190.A225 A206 


046L 












seaaaaejaaaj 


EIF51 


Input nto fauts 


5 


A222A224 


047L 












HHHHI 


cm 


CFF hole faults 


10 


A218 


048L 
















CFF servo faults 


10 


A206 


049L 












■Ha^Hil 


pm 


Too fdr lata to tray exit 


15 


A193 


050L 






4 






LaTesVHH 




Toe M» 'ate i*f "mv exrt fNW) 


10 


A070 


051L 






i 






resiLj 




Too fdr tate oft tray exit ttnv) 


10 


A200 


052L 
















I 

5 


Too fdr late to Platen Entrance (N-0 


10 


A 194 


053L 
















Tod fdr late to Platen Entrance (tnv) 


10 


A192 


_054t 






i 






HafaMHI 


feu 


Tod fdr. tate off pftn. entr 




A069 


055L 








I 




aiflHHI 


•S3 


Too fdr. late to ottn. exit 




A195 


056L 














Tod fdr tate to trav entr. 


5 


A196 


057L 




i 










Too fdr (ate off :rav entr. 


5 


A197 


058L 










! 0581 |B 


Too fdr miscounts 


10 


A201.A237 


- Q5* 










aaaaamii 




I 

» 


Tod fdr muftrfeeds 


10 


A202 


.,0604, 










aaaaaaii 


E31 | 


Doc handler shutter fault 




A016.A013 


061L 










I 061L 




Tod far set seoerator mtsflio 


10 


A07 2 












aaaaaii 


tall 




CFF 1* form off-feed fault 


10 


A228 


063L 




-4 






aaaaaii 


rail 



Tho Thrtsh Id b«tw**n calls is 90K for 5892 and 60K for 5680 - The) Thrash Id is 20 f r Systams with Sida Fe*dar 



AD\UA 



Descripti n 


Date-* 














AH M ters - 
















Thr 


Fault Cd 


Loc 


1 


2 


3 


4 


5 


Loc 


gpM w« «*H«t 


2_ 


MOTS , . 


HOL- 
















2 


J144.JU5 H017 


0O3L 












003L 




2 


J146.JU7 H018 


004L 












C04L 


XER failed self-test 


2 


J148JU9 H019 


0051 


- r 










cost 




2 


J023.J188 J189 


006L 


1 — 










006L 


FOR failed serf-test 


2 


J155.J156L020 


007L 


— r " 










007L 


Shared line failure 


2 


HOI 4 


0O8L 


i 










0O8L 








t AC vaitaee fault 


s 


P059 


M9L .- 












I009L 




5 


F060 


010L 












010L 


k Transfer current rauit 


5 


JC61 


OWL 














* * L 




5 


F062 


01 2L 














012L J 




S 


F063 


0131 














01 3L i 




5 


F064 


014L 












*NAME? 


014L J 




5 


F065 


01 5L 














015L i 




5 


J067 


016L 














01 6L i 




5 


F068 


017L 














017L i 


Svstem Errors 1 








Svetmm mrmriCBM ; 


S 


m - 


Q1SL 














Svstem error <iSm 


5 


ivA 


019L 






/ 








Svstem error fPHR) 




N/A 


020L 














wssss 




5 


N/A 


021 L 














Frffl 




5 


N/A 


022L 














Fr^H 




5 


* N/A 


023L 














ESI 




3 ' 


" " N/A 


0241 




























2 


JQ28 


026L 














026L 


Tc" *e*.v *n't ^oi<?s 




H029 


02T. 














027l| 




2 


F137 


028L 














028L| 




5 


F004 


029L 














029L l 




5 


F005 


030L 














mm 




5 


F006 


031L 


















5 


F007 


032L 


















5 


R»8 


033L 


















_S, 


F009 


034L 














ehh 




5 


F010 


035L 




















F011 


036L 


















5 


F012 


037L 
















Notreadv m 12 sec 


. u 


F087 


038V 


















35/90 


N/A 


039L 


















5 


F135 


040U 












1 040L 


Document Handler Faults 








Side fdr tate to Dim. entr" _ 




A211 


042L 


















10 


A212 


043L 
















Side fdr. lata to otn.eoat 


10 


A213 


044L 
















Side fdr late off ottnaat 


10 


A214 


045L 












■BSBB 




Platen da mo faults 


5 


A190.A225A206 


046L 












■■■■ 




Input nip f»ua* 


5 


A222.A224 


047L 












mmmm 




CFF note faults 


10 


A218 


048L 












aaaflaa 




CFF servo faults 


10 


A208 


049L 












BHBBa 






15 


A193 


050L 






4 










Tor 'ate of •nv exit (HA\ 


10 


A070 


051L 






-i 












10 


A2Q0 


0S2L 












■■alsaH 




10 


A194 


0S3L 


i 


i 






HHHH 






10 


A192 


054L 






i 












10 


A069 


0$5L 




















A195 


056L 














Too fdr tate to trav entr. 


L 


A196 


057L 




i 






1 057L. 8 


Too fdr late eft trav entr. 


5 


A197 


0S8L 










1 C58L_ B 




10 


A201.A237 


059L 






H 




BBBBVI 






10 








-v- 






BSHI 








A016.A013 


061L 
















10 


A072 


062L 












062L 




10 


A22S 


063L 












063L| 



AO\UA 



A 
A 
A 
A 
A 
A 
A 
A 
A 


Description 


Date-* 

















AH Meters — 
















Self - Test Faults 


Tnr 


Faulted 


Loc_ 




2 


. 3 _ 


4 




Loc 


rnM fail** «*tf.Tg«t 


2 


H0 15 .... 


OOOL 
















PHR failed sefMest 




J 14-4. J US H0 17 


0O3L 












003L 




MIR failed serf-test 


2 


J146.J147 H018 


004L 












C04L 




XER failed self-test 


2 


J148J149 H01 9 


005L 












C05L 




ISA failed self-test 


2 


J023.J1B8 J189 


006L 


I 














FOR failed setMesi 


2 


J155J156L020 


007U 


" i 










007L 




Shared line failure 


2 


H0 14 


008L 


i 










006L 




H.V. Faults 
















AC vettaeg fault 




RK9 ._ 


009L 


















S 


F060 


01OL 


_ i — 










010L 


; 




5 


J061 


311L 














i G'*L 






5 


F062 


01 2L 














01 2L 






5 


F063 


013L 














0131 


A 




5 


F064 


014L 












•NAME? 


0141 


A 




5 


F06S 


01 5L 














01 5L 


A 


Waste roll bias fault 


5 


J067 


016L 














01 6L 


A 




5 


F068 


017L 














017L 


A 


System Errors 














Sv*tem emrlCDM) 


5 


N/A 














I018L 




Svsiem error ii5ni 


5 




019L 






/ 






bbbbbbbVbbbbIhE!! 




Svstem error (PHR) 


5 


N/A 


020L 


















5 


N/A 


021 L 














Fm 




5 


N/A 


022U 














ESI 




5 


" WA 


023L 


















3 ' 


T " N/A 


024L 
















Timing Faults 








Timinn r»«*f fanttt 


2 


J028 


026L 












JQ2SL 


T?- **w *f?'t ^f?*»S 


? 


«->029 


0271 












027li 


Too many belt holes 


2 


F137 


028L 














Oftl) 




COM lost machine clocks 


5 


F004 


029L 














Q29L l 


MIR lost machine docks 


S 


F005 


030L 
















B 

B 
3 
B 
B 


XER lost machine docks 


5 


F006 


031L 














FTTH 


PHR lost machine docks 


5 


RXJ7 


032L 
















COM lost oitch resets 


5 


F008 


033L 


















5 


F009 


034L 
















XER lost Ditch resets 


S 


F010 


035L 




















5 


F011 


036L 


















ISR lost Ditch resets 


5 


F012 


037U 














ESI 




Not readv in 1 2 sec. 


*S 


F087 


038L 


















No. of reortasino cycles* 


35/90 


N/A 


039L 


















Failed to rwnase in 30 rev. 


S 


F135 


040L 












tOAOL 




Document Handler Faults 






Sidc'dr 'ateiQalTT, smr." 




A211 


042L 


















Side fdr. lateoff otn. entr." 


10 


A212 


043L 












aaaH 


ESI 




Side fdr. tate to Dtn.est 


10 


A213 


044L 












■BBBBB1 


EZH 




Side fdr. tate off Dtrteaot 


10 


A214 


04SL 












mmm 






Platen damo faults 


5 


A190.A225 A206 


046L 












aaaaaai 






Inout nto fauts 


5 


A222>224 


047L 












■BUM 






CFF hole faults 


10 


A218 


048L 














0481 






10 


A208 


049L 














049L 


3 




15 


A193 


050L 






-J— 








050^ 




To= **» '?te i*f t*v exit 


10 


A070 


051L 






1 








G51L, 


Too fdr ate oft trav exit iinv) 


10 


A200 


052L 








a* 




bbbbbbbM 


mm 




Tod fdr late to Platen Entrance fN-0 


10 


A194 


053L 






1 






HHHHI 








10 


A192 


054L 






1 






HsHaaall 


GSM 




Too fdr. late off Dtm. entr 


10 


A069 


055L 








t 




LibbbbIMHI 


ESS 


3 




10 


A195 


056L 










■■■■! 


ESI 


3 


Tod fdr late to trav entr. 


5 


A196 


057L 




i 






bbbbbbIbbbVI 


fru 


3 


Too fdr late off :rav entr. 


5 


A197 


C58L 












058L 


3 




10 


A201.A237 


059L 






H 






059^ 


3 


Tod fdr muftrfeeds 


10 


A202 


06CL 


















5 


A016>013 


061L 












<r*% 






10 


A072 


062L 












2621 






10 








— I 








0631 



Tht Threshold between calls Is 90K for 5892 and G0K for 5680 "TheThrtsh Id Is 20! r Systems with Side Fseder 



AD\UA 



Descripti n 



Date— 



AH M ters -> 



Self - Test Faults 



Thr 



Faulted 



Loc 



PHR failed setf-test 



J144.J145 H0 17 



003t 



003L 



MIR tailed serf-test 



J146 J147 H018 



0Q4L 



CQ4L 



XER failed scutes: 



J148.J149 H019 



OOSL 



OOSL 



ISR failed self-test 



J023J188 J189 



006L 



006L 



FOR failed sett-test 



J1S5.J156LQ20_ 



0071 



0071 



Shared line failure 



HQ14 



008L 



0081 



H.V. Faults 



AC voitaee fault 



J2QSL. 



A lCharqe «2 voitaoe fault 



F060 



010L 



01 PL 



AdTransier current rault 



J061 



JUL 



A Predean current fault 



F062 



01 2L 



01 2L 



Developer bias fault 



F063 



01 3L 



01 3L 



Toner bias fault 



Cleaner bias fault 



F064 



0144, 



FQ65 



015L 



»NAME? 



014L 



01 SL 



Waste roll bias fault 



Arc detector fault 



J067 



016L 



rose 



0171 



0161 



0171 



System 



Errors 



ft*«fm mrmr(CDM) 



N/A 



£22L 



>vstem < 



System error f PHR) 



01 9L 



N/A 



020L 



020L 



Svstem error fMlR) 



N/A 



021L 



021 L 



Svste 



rOCER> 



N/A 



022L 



System error (FOR) 



N/A 



PoweMoss^n^nn^ 



N/A 



0244. 



I 0241 



Timing 



Faults 



Ttmino reset faults 



Q26L 



Tc? >'.v »et *c!»s 



H029 



027*. 



027 



Too many belt holes 



F137 



J328L. 



029LI 



COM lost machine clocks 



F004 



0291 



MIR lost macfiine docks 



FOOS 



030L 



030C 



XER lost macfyne docks 



F006 



031L 



031 L 



PHR lost machine docks 



FOOT 



0321 



032L 



COM lost pitch resets . 



F008 



033L 



0331 



MIR tost pitch resets 



F009 



0344- 



034^ 



XER tost pftcn resets 



F010 



Q3SL 



035L 



teai s trati o n firoef faufts 



F011 



036L 



ISR lost pitch resets 



F012 



037L 



Not readv in 1 2 sec. 



F087 



036L 



No. of reohasinq cvdes' 



3S/90 



N/A 



039L 



Failed to reonase in 30 rev. 



_F135 



040L 



I Q4QL 



Document Handier Faults 



fiidnfrtf latittoorm entr' 



0421 



Side fdr. lateoff pen, entr." 



10 



A212 



0434. 



Side fdr. late to ptn exrt 



10 



0444. 



Side fdr. late off pkrteaft 



10 



A214 



04SL 



Platen damp faufts 



A190 A22S A206 



04a. 



Input nip fauts 



047L 



CFF hoie faufts 



10 



A216 



048L 



CFF servo faults. 



10 



A20B 



049L 



B Top fdr lata to tray exit 



Ji. 



A193 



050L 



Tnz ? f '?t e of *r*v exit (HA) 
Top fdr ate off tray exit dnv) 



10 



A07Q, 



0S1L 



10 



A2QQ 



0S2L 



1051'- 



Too fdr late to Platen Entrance (HA) 



10 



A194 



0S3L 



Top fdr late to Platen Entrance (Inv) 



10 



A192 



OS* 



Top fdr. late off pftn. entr 



10 



A069 



_05SL. 



B 



Top fdr. late to pftn. exit 



10 



0S6L 



Top fdr late to trav entr. 



057L 



IB 

"l :s6l1b 



Too fdr late erf :rav entr. 



A197 



058L 



Top fdr miscounts 



10 



A201.A237 



0S9L 



± 



Top fdr mufttfeeds 



10 



>x handler shutter fault 



A016>013 



061L 



T 061L 



Top far set seoemtor maflo 



10 



A072 



-SSL 



4- 



CFF i" form off-feed faun 



10 



A228 



063L 



The Threshold between calls is 90K for 5892 and 60K for 5680 



~ The Threshold is 20 for Systems with Side Feeder 



I 300U/«JQM ww — - • - w 

5 ADVUA 





Descripti n 


Date-* 


















AH M 


ters -* 




















Thr 


Fault Cd 


Lqc 


1 


2 




4 


5 


Loc 








2 - 


H01S 


,,,, OWL . 












COOL 






PHR failed sen-test 


2 


J144.J145 H017 


0O3L 












003L 






MIR failed serf-test 


2 


J146JU7 H018 


004L 


t 










004 L 






XER failed serf-test 


2 


J146.J149 H01 9 


0O5L 


t 










C05L 






ISR failed self-test 


2 


J023.J188 J 189 


0O6L 


— i — 










0O6L 
007L 






FOR failed sefMest 


2 
2 


J1MJ156L020 
H014 


0O7L 
0O8L 


— T 


















H V. Faults 














A 




5 


**9 


0O9L 


















A 




5 


F060 


010L 














010U 




A 




5 


JC61 


311L 














Z' ". L 




A 




5 


F062 


01 2L 














01 2L 




A 




5 


F063 


01 3L 














01 3L 




A 




5 


F064 


014L 












•NAME? 


01 41 




A 




5 


F06S 


01 5L 














01 5L 
01 6L 




A 
A 




5 
5 


J067 
F068 


016L 
017L 














0171 






























_S— 


m 


Q1SL 












(018L 








1 s 




019L 
























N/A 


020L 














FPU 








5 


N/A 


021L 
























N/A 


























- N/A 


023L 














ESI 








3 


~ " N/A 


0244. 




































T,mmn m<« faults 


2 


JQ28 


Q26L 1 


-I 1 1 




Q2feL 








-5 


t 4029 


027L 1 






027l| 






2 


F137 I 


Q28L 






















5 


F004 


02SL 














029C 








5 


F005 


030L 














030L 








5 


F008 


031L 














Q31L 


XX 






5 


F007 


032L 














hwn 








5 


F008 


<SS- 






















5 


P009 


0344. 














EES 

KERB 








5 
5 


F010 
F011 


035L 
036L 














0361 1 








5 


F012 


°3?3- 




















Not readv in i2see. 


^5 


F087 


<W 














EE£H 






No. of reohasina cvdes* 




N/A 
























S 


F135 


040L 












I040L 



























Sidefdr latetoolm.ertr" 


.,1220. 


A211 


042L 






















10 


A212 


043L 














E5S 








10 


A213 


044t 














ES 








10 


A214 


045L 














ins 








s 


A19O.A225 A206 


046L 












I 


Q46L 1 








5 


A999A994 


047L 






















10 


A218 


048L 














ESI 








10 


A208 


049L 














EES 




B 




15 


A193 


050L 






4 








EES 






To- M- 'ate i*f tuv exit (1*4) 


10 


A070 


05H 






-j 






I 


051 L 








10 


A200 


052L 






















10 


A194 


053L 






» 








EI5S 








10 


A192 


054L 














EES 








10 




055L 








I 




BMW 


ESI 


/ 


B 


Too tdr. tate to oftn. exit 


10 


A195 


056L 












ESI 


B 


Too fdf late to trav entr. 


5 


A196 


057L 










I057L 




8 




5 


A197 


0S6L 










I 


058L 


XX 


B 




10 


A201.A237 


0S9L 






H 






059L. 




B 




10 


A202 






-v- 








060L 








5 


A016.A013 


061L 












061L 






10 


A072 


062L 












362L. 


1 




10 




063L 




— « 








063L 



B 



The Threshold between calls is 90K for 5892 and 60K for 5680 - The Thresh Id is 20 for Systems with Side 



